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dynamic  data  measured  in  a  wind  tunnel  or  on  analytical  prediction  using  methods 
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these  characteristics  is  required.  This  report  documents  the  development  of 
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The  report  first  presents  the  selection  of  a  mathematical  model  to  represent  a 
V/STOL  aircraft  (the  X-22A).  This  is  followed  by  a  discussion  of  available  identi¬ 
fication  technique^.  Based  upon  a  thorough  knowledge  of  the  requirements  of  this 
program  and  the  limitations  of  the  available  techniques,  advanced  techniques 
suitable  for  identification  of  V/STOL  aircraft  stability  and  control  parameters  are 
developed.,  , These  advanced  techniques,  which  were  developed  by  CAL,  are:  a 
suboptimal  fixed-point  nonlinear  data  smoothing  technique  for  estimation  of  par¬ 
ameters  ano  unknown  forcing  inputs  to  detect  the  modeling  errors;  a  start-up 
procedure  for  ihe  fixed-point  smoothing  algorithm;  and  an  improved  computational 
algorithm  for  the  variances  of  the  fixed- point  smoothed  estimates.  The  developed 
techniques  are  thfen^applied  to  the  identification  of  the  X-22A  stability  and  control 
parameters  from  computer -gene rated  data,  Princeton  Dynamic  Model  Track  data, 
and  available  X-22A  flight  data. 
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.ABSTRACT 


Contemporary  analyses  of  transition  flight  of  V/STOL  aircraft  are 
bastd  on  aerodynamic  data  measured  in  a  wind  tunnel  or  on  analytical  pre¬ 
diction  using  methods  developed  for  conventional  aircraft.  The  validity  and 
accuracy  of  these  techniques  for  V/STOL  aircraft  has  not  yet  been  estab¬ 
lished,  and  it  is  essential  that  they  be  correlated  with  flight  test  data  through 
parameter  identification.  In  spite  of  the  complicated  nature  of  V/STOL  dy¬ 
namics  in  transition,  some  method  of  identifying  these  characteristics  is 
required.  This  report  documents  the  development  of  identification  techniques 
to  meet  this  requirement. 

The  report  first  presents  the  selection  of  a  mathematical  model  to 
represent  a  V/STOL  aircraft  (the  X-22A).  This  is  followed  by  a  discussion 
of  available  identification  techniques.  Based  upon  a  thorough  knowledge  of 
the  requirements  of  this  program  and  the  limitations  of  the  available  tech¬ 
niques,  advanced  techniques  suitable  for  identification  of  V/STOL  aircraft 
stability  and  control  parameters  are  developed.  These  advanced  techniques, 
which  v.-ere  developed  by  CAL,  are:  a  suboptimal  fixed-point  nonlinear  data 
smoothing  technique  for  estimation  of  parameters  and  initial  state  of  nonlinear 
dynamic  systems  having  a  large  number  of  parameters  and  unknown  f  ;  -cing 
inputs;  a  method  for  estimating  the  unknown  forcing  inputs  to  detect  the 
modeling  errors;  a  start-up  procedure  for  the  fixed-point  smoothing  algor¬ 
ithm;  and  an  improved  computational  algorithm  for  the  variances  of  the 
fixed-point  smoothed  estimates.  The  developed  techniques  are  then  applied 
to  the  identification  of  the  X-22A  stability  and  control  parameters  from 
computer -gene rated  data,  Princeton  Dynamic  Model  Track  data,  and  avail¬ 
able  X-2  2A  flight  data. 
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SECTION  I 


INTRODUCTION 

Tne  transition  of  a  VTOL  aircraft  from  hovering  flight  to  conven¬ 
tional  flight  and  vice  versa  involves  large  changes  in  the  vehicle's  aerodynam¬ 
ic  characteristics.  Contemporary  analyses  for  transition  flights  are  based 
on  aerodynamic  data  measured  in  a  wind  tunnel  or  on  analytical  prediction 
using  the  same  methods  as  for  conventional  aircraft.  The  validity  and  accu¬ 
racy  of  these  techniques  for  VTOL  aircraft  have  not  yet  been  established. 
Parameter  identification  can  be  used  to  determine  the  validity  of  these  tech¬ 
niques  and  at  the  same  time  yield  an  independent  and  more  powerful  method 
of  data  analysis. 

The  realization  that  existing  parameter  identification  techniques  were 
inadequate  to  handle  the  complex  and  unique  problems  of  a  VTOL,  such  as  the 
X-22A,  served  as  a  powerful  motivation  for  this  study.  At  the  onset  of  the 
study,  no  kiown  technique  had  been  developed  that  could  cope  with  the  prob¬ 
lems  of  significant  nonlinearities,  large  number?  of  parameters,  imperfect 
mathematical  modeling,  and  noisy  measurements,  all  of  which  characterize 
the  VTOL  identification  problem. 

The  identification  of  V/STOL  aircraft  characteristics  in  transition 
flight  is  one  of  the  most  complex  identification  problems  yet  to  be  attacked. 
First,  this  complexity  arises  from  the  fact  that  the  equations  of  motion  are, 
in  general,  nonlinear  and  time  varying  over  most  of  the  transition  range,  in 
contrast  to  the  equations  for  a  conventional  aircraft,  which  are  frequently 
well  represented  by  linear,  constant  coefficient  "small  perturbation"  approxi¬ 
mations.  Secondly,  a  more  fundamental  difficulty  is  the  relative  uncertainty 
in  formulating  the  V/STOL  equations  of  motion  due  to  the  complex  interaction 
and  incomplete  definition  of  propulsive  a«.d  -'**rodynarnic  forces  and  moments. 
A  lai^e  number  of  parameters  is  usually  required  to  describe  these  forces 
and  moments.  For  example,  in  <■.  previous  study  (Reference  1),  an  identifica¬ 
tion  model  was  obtained  using  a  Taylor  series  expansion  about  a  reference 
trajectory;  unfortunately,  even  with  a  low  order  (third  order)  Taylor's 
series  expansion,  and  with  physical  arguments  to  eliminate  negligible  deriv¬ 
atives,  there  remain  in  the  model  more  than  60  derivatives  which  vary  as  a 


l 


function  of  the  thrust  vector  angle.  Thus,  we  are  faced  with  an  identification 
problem  oi  a  nonlinear,  time  varying  system  having  a  large  number  of  param¬ 
eters.  Finally,  measurements  of  the  dynamic  motions  of  the  vehicle  are 
usually  corrupted  with  noise.  Although  this  is  a  problem  common  to  all  types 
of  aircraft,  it  appears  to  be  more  acute  for  Y/STQL  aircraft.  Based  on 
available  flight  records,  the  noise  levels  in  the  measurements  of  the  V/STOL 
aircraft  motions  are  significantly  higher  than  those  of  conventional  aircraft. 

The  particular  features  of  the  V/STOL  identification  problem  may 
therefore  be  summarized  as: 

1.  nonlinear  dynamic  motions,  represented  by 

2.  large  numbers  of  parameters,  containing 

3.  significant  modeling  errors  and  whose 

4.  measurements  are  contaminated  with  noise. 

In  spite  of  the  complicated  nature  of  this  V/STOL  parameter  identifica¬ 
tion  problem,  some  practical  identification  techniques  must  be  developed. 
Clearly,  the  p  trameter  identification  technique  for  the  V/STOL  aircraft  must 
be  capable  of: 

1.  determining,  to  the  best  possible  accuracy-,  the  numerical 
values  of  the  unknown  parameters,  i.e.,  stability  and  con¬ 
trol  derivatives  in  the  mathematical  mode)  chosen,  and 

2.  detecting  the  dynamic  modeling  errors  to  improve  the 
mathematical  model  which  better  represents  the  V/STOL 
aircraft  dynamics. 

Although  the  se<  ipability  is  occasionally  overlooked,  it  becomes  an 

important  part  of  the  identification  problem  for  V/STOL  aircraft  and  will  be 
discussed  at  length  later.  For  conventional  aircraft,  the  form  of  the  ;quations 
is  generally  well  known,  and  the  first  capability  becomes  of  primary  impor¬ 
tance.  Before  the  advent  of  th-  digital  computer,  the  usual  method  of  obtain¬ 
ing  numerical  values  of  the  parameters  was  through  analog  matching  tech¬ 
niques,  a  method  which  still  finds  use  today.  With  the  advent  of  digital  com¬ 
puters,  the  capability  to  handle  large  amounts  of  data  in  equations  that  might 
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need  to  be  solved  numerically  became  feasible.  This  capability  led  first  to 
so-called  "equation  error"  techniques,  such  as  the  well  known  classical 
least  squares,  or  equations -of- motion  method,  and  then  to  more  advanced 
"response-error"  techniques,  such  as  quasilinearization,  Newton-Raphson, 
conjugate  gradient,  and  so  on. 

The  merits  or  debits  of  all  these  techniuqes  are  a  function  of  the 
quality  of  their  parameter  estimates  in  the  presence  of  various  types  of 
uncertainty,  or  noise.  For  the  aircraft  problem,  as  well  as  most  others, 
there  are  two  types  of  noise  that  are  of  importance: 

1.  Measurement  noise.  The  pa  ameters  of  the  mathematical 
model  are  estimated  in  all  cases  by  making  use  of  measure¬ 
ments  of  the  state  and/or  accelerations  of  the  system  over 
a  time  span.  Since  no  measurement  is  perfect,  these  mea¬ 
surements  will  have  uncertainties,  or  noise,  which  will 
affect  the  parameter  estimates. 

Z.  Process  noise.  Process  noise  may,  in  general,  consist 
of  unknown  random  inputs  to  the  system  (e.g.,  gusts,  fuel 
clange)  and  errors  in  the  mathematical  model  (e.g., 
neglecting  a  stability  derivative  in  the  model). 

Essentially,  equation-error  techniques  give  biased  estimates  in  the  presence 
of  measurement  noise,  and  pure  response-error  techniques  give  biased 
estimates  for  nonlinear  systems  in  the  presence  of  process  noise.  Although 
response-error  techniques  such  as  quasilinearization  can  be  shown  to  exhibit 
certain  advantages  over  equation-error  techniques,  they  do  not  have  the 
second  capability  of  detecting  errors  in  the  assumed  model,  which  is  an  im¬ 
portant  part  of  the  V  /STOL  identification  problem. 

With  the  knowledge  of  the  limitations  given  above,  the  present  study 
of  V/ STOL  identification  techniques  was  undertaken.  Without  going  into  the 
mathematical  details  at  this  point,  the  identification  technique  developed  by 
CAL  essentially  consists  of  a  three-stage  process: 


3 


1. 


Initial  estimates  of  the  parameters,  ana  their  variances, 
in  the  assumed  equations  are  obtained  by  a  method  that  is 
essentially  an  equation-error  technique.  Since  the 
variances  obtained  by  this  method  do  not  adeq  ’ately  rep¬ 
resent  estimation  errors,  an  improved  variance  estimate 
is  obtained  by  c:  Cramer-Rao  lower  bound  computation, 
thereby  facilitating  a  better  initialization  of  the  locally 
iterated  filter-smoother  algorithm. 

2.  An  extended  Kalman  filter,  utilizing  a  "local  iteration*' 
or  "multi-correction*'  algorithm,  is  used  to  refine  the 
initial  estimates  of  the  parameters.  Although  the  ex¬ 
tended  Kalman  filter  gives  biased  estimates  when  applied 
to  a  nonlinear  problem,  which  is  inherent  to  parameter 
identification,  it  can  be  shown  that  the  multi- correction 
scheme  reduces  biases  due  to  nonlinearities  by  improving 
the  reference  trajectory  between  data  points. 

3.  A  fixed-point  smoothing  algorithm,  which  actually  works 
in  conjunction  witVt  the  multi-corrector  at  each  data  point, 
is  used  to  further  refine  ihe  parameter  estimates  and 
separate  out  the  effects  of  process  noise.  This  step  is 
extremely  important  as  a  first  attempt  at  determining 
the  mathematical  modeling  error,  as  well  as  improving 
the  parameter  estimates.  Also,  a  more  accurate  variance 
computation  of  the  parameter  estimate  is  obtained. 

These  techniques  are  fairly  general  and  ate,  theoretically  speaking, 
applicable  to  the  identification  of  unknown  parameters,  initial  state,  and 
unknown  forcing  functions  of  a  wide  class  of  nonlinear  dynamic  systems.  As 
such,  these  techniques  may  have  potential  applicability  to  identification  of 
stability  and  control  parameters  of  many  flight  vehicles  other  than  V/STOL 
aircraft,  especially  for  these  vehicles  in  large  motion  such  as  in  spins  and 
post-stall  gyrations.  However,  as  the  number  of  unknown  parameters 
increases,  the  computer  time  increases  rapidly,  and  therefore  the  analysis 
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of  a  large  amount  of  data  for  systems  with  a  large  number  of  unknown  param¬ 
eters  may  not  be  economically  feasible. 

This  report  is  organized  as  follows:  Section  II  discusses  the  selection 
of  a  mathematical  model  to  represent  the  X-22A  aircraft  and  formulates  the 
identification  problem.  A  discussion  of  identification  techniques  is  given  in 
Section  III.  Section  IV  discusses  the  identifiability  of  the  parameters.  The 
development  of  final  identification  technique^  for  the  V/STOL  aircraft  and 
numerical  verification  are  presented  in  Sections  V  and  VI,  respectively. 
Applications  of  these  advanced  techniques  to  experimental  data  are  given  in 
Section  VII.  Finally,  the  conclusions  and  recommendations  are  given  in 
Sections  VIII  and  IX,  respectively. 
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SECTION  II 


MATHEMATICAL  MODEL  AND  FORMULATION  OF  THE  PROBLEM 

In  this  section,  the  formulation  of  the  equations  of  motion  used  to 
represent  the  X-22A  dynamics  will  first  be  discussed.  With  the  determination 
of  a  mathematical  model  of  the  X-22A  aircraft  and  the  definition  of  the  data 
which  will  be  available,  the  problem  of  identifying  the  stability  and  control 
parameters  of  the  X-22A  aircraft  will  then  be  formulated. 

2.  1  Mathematical  Model 


The  general  description  of  a  VTOL  aircraft  such  as  the  X-22A  poses 
a  fundamental  difficulty,  fn  general,  VTOL  aircraft  exhibit  highly  nonlinear 
behavior,  the  result  of  c^  -oplex  interactions  of  aerodynamic  and  propulsive 
forces  and  moments  during  transition  maneuvers.  In  particular,  the  dynamic 
motions  in  the  plane  of  symmetry  exhibit  pronounced  nonlinearities  during 
transitions,  and,  as  such,  pose  the  most  difficult  modeling  problem.  It  is 
the  purpose  of  the  formulation  to  define  a  mathematical  model  of  the  plane- 
of-symmetry  dynamics  that  is  simple  enough  to  facilitate  the  determination 
of  its  unknown  parameters  yet  complex  enough  to  include  the  paramount 
features  of  the  VTOL  aircraft  in  transition.  Specifically,  the  task  is  to 
determine  a  representation  of  %  ,  ^  ,  w  in  the  following  equations  of  motion, 
written  with  respect  to  a  body-fixed  axis  system: 

u  +  t-  q  S'rt  Q  »  ye- 

uf-  yu-  -  9  aa  Q  =  ^  (2.1) 

where  ^  7,7 

£  =  0 

*  =  X _ 

mass  of  the  aircraft 


J 


X,z 


M 
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_  rf—  _ 

mass  of  the  aircraft 
M 

pitching  moment  of  inertia,^ 

aerodynamic  (including  thrust)  forces  along  body 
axes,  forward  and  downward  respectively 
aerodynamic  pitching  moment 
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The  aerodynamic  forces  and  moment  (  *  ,  ,  ffl  )  in  these  equations 

are  functions  of  the  flight  variables  and  the  control  motions.  For  a  VTOL 
aircraft  such  as  the  X-22A,  there  are  three  independent  control  variables: 
thrust  inclination  { X  ),  thrust  magnitude  (B)»  and  pitching  moment  mag¬ 
nitude  {  ).  Excluding  unsteady  aerodynamics,  then,  we  may  write: 

X  =  V>  (u,  ur,  <f ,  Z,  jf,  3es  )  *  u.  *  gcw  +  g  sin  t' 

*  'y{u,,u/,  gt  1,3,$.^)  =  ir-gu,-  g<u?s9  (l  Z) 

rrt  -  S,S£S)  =  g 

As  can  be  sc^n,  there  are  four  equations  in  seven  (7)  unknowns:  u  ,  ur  ,  g  , 
9 ,  X  ,  3  ,  Sc*  .  Therefore,  three  variables  must  be  specified  to  determine 
the  other  four.  For  example,  if  an  attainable  reference  trajectory  ur(i)» 
u,(b)  ,9(t)  is  specified,  then  q(t),  X(t)  ,  B  (i)  ,S£9(t^  may  be  determined.  In 
this  example,  U>(t)  ,ur(t)  rnay  be  chosen  to  be  uniformly  accelerating  (  or 
decelerating)  with  9(1)  -  0;  for  the  X-22A  however,  X(6)  is  somewhat  con¬ 
strained,  and  such  a  trajectory  might  not  be  achievable. 


For  the  X-22A,  it  is  reasonable  to  specify  %(&)  {usually  as  a  constant 
rate  of  change  of  duct  angle),  if  (t)  -  G(i)  -<&(£)  and  9  (t)  .  In  this  case,  u-(i)  , 
g(t),  %(t)  ,  2es(t)  may  then  be  determined  for  the  reference  trajectory.  One 
might  then  be  tempted  to  expand  equations  (2.2)  in  a  Taylor  series  about  this 
determined  trajectory,  as  was  done  in  Reference  1.  There,  the  specifications 
were:  TfC^J  =  0,  X  =  -3  deg/sec  and  9(t)  varying  between  0°  at  X  =  90*  to  the 
value  required  for  level  flight  at  X  -  0*.  Then  the  determined  trajectory 
may  be  written  as  ro(%)  -^Ug (%), uT0 (l)1  ^ (l), St  (X)J T  and  the  X  -force  may 

be  expanded  as: 


B 


i 


where  Ar  =  r-  f"c  (X) 

f;  =  u.,ur,  g,S,S£s 


(2.3) 


Unfortunately,  such  a  representation  has  several  drawbacks.  The 
first  is  that  a  large  number  of  parameters  is  required  for  an  adequate  rep- 
resentation  of  the  %  force.  For  example,  a  third -order  expansion  (K=3) 
results  in  more  than  60  derivatives  at  each  duct  incidence,  «nd  if  a  polynomial 
fit  of  the  \  variation  is  assumed,  then  more  than  240  parameters  would  need 
to  be  identified.  The  second,  more  fundamental,  difficulty  with  this  approach 
is  its  strong  local  property.  As  we  have  seen,  uff(t) ,  cS,  (t)  and  Ba(i)  for  the 
reference  trajectory  are  determined  by  the  specification  of  X0(t)}  It)  and 
9o  (t)  .  The  choice  of  \(t)  indicates  whether  the  reference  is  a  takeoff 
(accelerating)  or  landing  (decelerating)  trajectory.  For  the  X-22A  aircraft, 

the  value  of  Ba(l)  and  u0(t)  ,  for  a  given  duct  angle,  are  widely  different  for 

ft 

accelerating  or  decelerating  transitions.  Since  tt>e  stability  derivatives 
in  (2.  3)  are  strong  functions  of  both  uB  and  Bc  ,  this  in  turn  means  that  the 
derivatives  determined  by  expansion  about  a  takeoff  trajectory  are  invalid 
for  a  decelerating  trajectory.  Hence,  (2.  3)  cannot  apply  to  both.  A  somewnat 
more  general  formulation  is  required. 

As  the  initial  step  toward  this  formulation,  let  us  draw  an  analogy 
with  the  "quasi-steady"  representation  ex'  the  aerodynamics  of  a  conventional 
airplane.  Consider  equations  (2.  2)  ir  equilibrium,  level,  steady  flight.  In 
this  case,  7f-0  ,  uf  =  q  »  d  *  0  ,  and  we  are  left  with  three  equations 

(since  =  0)  in  five  unknowns  Therefore,  two 

of  the  unknowns  must  be  specified  to  determine  the  other  three.  A  logical 
choice  is  c/,  and  3  ,  and  thus: 

e  =  e(u,x) 

(2.4) 

§£S  =  Se  9  (u.}  %) 

Note  that  these  equations  are  analogous  to  the  equilibrium  relationships  for 
a  conventional  airplane,  where  the  controls  and  angle  of  attack  are  specified 
as  a  function  of  the  single  variable  u.  ,  but  that  the  additional  control  (  X  ) 
now  makes  S  =  a( ,  3  (or  power),  and  Ses  functions  of  two  variables.  At  a 

v  This  difference  arises  from  the  fact  that  an  accelerated  transition 

requires  a  larger  thrust  ( B  )  to  accelerate,  and,  uince  more  of  the  weight 
is  then  supported  by  thrust  rather  than  lift,  a  smaller  velocity  and  angle 
of  attack. 
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fixed  duct  angle,  clearly,  they  are  directly  comparable. 


Near  equilibrium  flight,  then,  the  stability  and  control  derivatives 
may  be  written  as  a  function  of  the  two  variables  u  and  %  if  the  dependence 
on  the  other  variables  is  nearly  linear  (  as  it  is  for  a  conventional  airplane). 
Since  this  is  not  a  perturbation  about  a  prescribed  trajectory,  but  is  instead 
a  general  quasi-steady  representation  of  the  aerodynamics,  it  should  be 
applicable  to  both  accelerated  and  decelerated  transitions  near  equilibrium. 
Note,  however,  that  equatior  *  (2.5)  are  now  nonlinear: 

*  *  *o(*t*)  *  *  %s  Ob*)** S 

>  -  (u-,l)Sg  *  (Uyi)se 8 

(2.5) 

m  -  +Tf>0'(u)%)ur  *■  +  *nsJu>,l)5g  *  >ns^ (u. ,  z)f£s 

To  determine  the  validity  of  this  model,  time  histories  for  a  portion  of 

if. 

a  takeoff  transition  from  the  full  ''global”  digital  computer  program  were 
compared  with  those  from  the  model.  The  stability  derivatives  were  assumed 
tc  be  represented  by  polynomials  in  u,  and  X  : 


1  (U*y  X)  = 


U  =  (/  ,  U  ,  u} ,  u.3) 
X  =  (/,  X  ,  Xz,  X*)T 


=  a  4x4  constant  matrix 


1  =  ^sBS 


(2.6) 


*  A  complete  set  of  six-degree-of-freedom  nonlinear  equations  of  motion 
with  available  aerodynamic  data  of  the  X-22A  we:  ;  programmed  on 
CAL's  IBM  260/65  computer  (see  Reference  1).  These  equations  will 
be  called  the  "global"  program  henceforth. 


The  terms  %a  (u.,X)  ,  j.g  (u-,%)  ,  and  ma  (u,X)  in  (2.4)  are  computed  by: 

*o(u>%)  =  $  s/> 9, ( u, X) -  (a, A.)are  (u, %) * x8 (u, X)B0 (a, l)  * ^  (»,Z)SssJittz) j 

?«>M  =  ~q<U>s0o(u,X)-  M  +  fs£S  fai)ses0(*,*>)]  (2.  7) 

*»#  M  *  ~  [w«,  (u-^)urt(u}  %)  *  ynB  ( a,'l)30  (u,  x)  *  (a,  X)S£Sg  (u,  x)J 

He  re,  ns0  (u-,  X)  ,  3a  ( u ,  2-)  ,  /t)  are  the  trim  (equilibrium)  values  of 

vertical  velocity,  collective  pitch,  and  longitudinal  stick  position.  These  trim 
values,  and  the  derivatives  zu/(u,x)  ,  etc.  were  obtained  from  the  digital 
computer  program  with  global  aerodynamics,  with  the  polynomial  represen¬ 
tation  being  achieved  by  a  least-squares  fit.  The  particular  transition  chosen 
was  X  =  -3  deg/sec  from  -  30*  to  %  -  15®,  a  0.4  inch  longitudinal  stick 
step,  and  a  ramp  collective  input.  These  responses  of  the  model  matched 
those  of  the  global  computer  program  quite  well,  thereby  indicating  the 
validity  of  the  model  (2.5). 

Unfortunately,  when  duct  angle  is  changing,  the  number  of  param¬ 
eters  m  this  model  i?  still  much  too  high  for  efficient  identification.  Also, 
although  the  model  was  shown  to  be  valid  for  a  transition  of  moderate  accel¬ 
eration,  it  probably  wouldn't  be  valid  for  transitions  far  off  the  equilibrium 
condition.  This  model,  then,  is  best  suited  to  provide  an  accurate  represen¬ 
tation  of  the  X-72A  dynamics  at  fixed  duct  incidence,  which  reduces  the 
number  of  parameters  to  be  identified  by  a  factor  of  four.  With  X  fixed, 
equations  (2.  5)  become: 

U  *qur  *  qj/T0  =•  i,0(p)  +  %v.(u)br+  t^(u,)3  (u)SB5 

uf-qu.  -  qcas  6  =  'yo(u.)+  %/ufar*  ^ (u) 8  *  (*)<f£s  (2.8) 

k  =  ^  (u)<l  *  w0  (u)  *  0^)ttr  y  (u)B*  (*)S£S 

Equations  (2.8)  were  verified  by  comparing  time  histories  as  previously 
described.  At  X  =  30°,  the  model  time  histories  were  an  excellent  mutch 
to  those  of  the  global  program  when  the  stability  derivatives  were  represen¬ 
ted  by  second-  and  third-order  polynomials  in  u  ,  and  the  matches  were  only 
slightly  degraded  by  using  only  first-order  polynomials.  This  mathematical 
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model,  then,  may  be  used  for  identification  of  fixed-duct  data. 

As  wr  have  seen,  both  a  pure  perturbation  about  an  accelerated  ref¬ 
erence  trajectory  (Equation  2.3)  and  a  quasi-steady  representation  around 
equilibrium  (Equations  2.  5)  do  not  yield  equations  that  are  tractable  for 
identification.  We  have,  however,  obtained  a  model  that  is  valid  and  useful 
at  fixed  duct  incidence  (Equations  2.8),  and  our  purpose  now  is  to  obtain  a 
similar  model,  by  a  combination  of  perturbation  expansion  and  quasi-steady 
representation,  that  will  be  valid  for  transitions. 

Consider  an  ideal  level  transition  with  zero  pitch  attitude.  This  is 
feasible  from  a  duct  angle  above  15  degrees;  and,  in  fact,  this  technique 
was  used  in  many  occasions  during  Phase  I  of  the  Military  Preliminary 
Evaluation  of  the  X-22A  (Reference  2).  Upon  constraining  the  transition  to 
be  at  constant  flight  path  angle  (zero  in  this  case),  and  zero  pitch  attitude, 
and  choosing  a  given  h(t) ,  it  can  readily  be  shown  that  a  unique  «  -  X  profile 
exists  from  Equations  (2.2)  and  (2.4).  V/e  may  therefore  choose  the  following 
references  for  slow  and  fast  transitions:  9  -  0,  7  -  constant  and 

^  «  0  (equilibrium  -  slow  conversion  and  reconversion) 

A/  =  -  5  deg/ sec  -  fast  conversion 

^  =  5  deg/sec  -  fast  reconversion 

Figure  2-1  shows  the  profile  for  the  slow  transition  with  9  -  2f  =  0. 

The  solid  line  represents  the  profile  obtained  from  the  digital  program  with 
global  aerodynamics  and  the  "circles”  are  taken  from  Reference  3.  The 
profiles  for  fast  conversion  and  fast  reconversion  can  be  obtained  from  the 
digital  program  or  from  the  flight  records  in  Reference  2. 

We  may  now  expand  Equations  (2.5)  about  the  chosen  reference  tra¬ 
jectory.  Note  that  the  unique  u--X  profile  means  that  the  coefficients  are  now 
functions  of  only  a-  or  %  ;  we  choose  to  make  them  functions  of  ^  so  that, 
at  fixed  duct  incidence,  they  will  reduce  to  Equations  (2.8).  Retaining  only 
first-order  terms  in  the  state  and  control  variables  (with  the  exception  of  ) 
Equations  (2.  5)  therefore  become  (after  substitution  into  2.  1): 
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(2.9) 


«•  +  qw  *  q  s  )n  6  -  (u) + (u.)Au/  *  %g  (u)A  2?  *  Zg  (u)A5£S  +  (u)  A  X 

£  £j 

-  qv>$0  ■-  ^  (>J  *7^  (u)£ur  *fo(u)&B  *  jgs  (u)A5bs  t  (u)AX 
q.  «  ^  <&)  ♦  ^  v-  KfrfujAv- + y»B(u)&d  +  +  jn^(u)AX 

(Note:  Here  the  subscript  IS  denotes  the  reference  trajectory 
and  Aar  =  ur-uTg  (u),  etc.) 

The  following  comments  concerning  theae  equations  are  in  order: 

1.  Although  we  have  been  forced  to  return  to  an  expansion 
about  a  reference  trajectory  as  in  Equations  (2.3),  the 
resulting  Equations  (2.9)  result  in  fewer  parameters 
to  be  identified. 

2.  Equations  (2.9)  reduce  to  (2.8)  when  AX  =  0  (fixed 
duct  incidence). 

3.  Equations  (2.9)  also  have  fe^  er  parameters  to 
identify  than  do  Equations  (2.5),  and  are  applicable 
to  both  slow  and  fast  transitions. 

4.  Equations  (2.9)  reduce  to  linear  equations  with  time- 
varying  coefficients  if  only  first-order  perturbations 
in  a  are  retained  (see  Appendix  A). 

5.  The  fact  that  the  reference  transition  may  not  be  at 
constant  pitch  attitude  throughout  4  o)  is  accounted 
for  by  -m0^  (u)  . 

Equations  (2.9)  then,  were  adopted  as  the  mathematical  model  of  the 
X-22A  dynamic  motions  in  transition,  and  Equations  (2.8)  were  adopted  at 
fixed  duct  incidence.  These  equations  are  now  used  to  formulate  the  param¬ 
eter  identification  problem. 
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2.2 


Formulation  of  the  Problem 


The  uncoupled  longitudinal  equations  of  motion  for  the  X-22A  in  tran¬ 
sition  flight  as  described  by  Equation  {2.  9)  are  now  used  as  the  mathematical 
model  for  the  X-22A  aircraft  for  the  development  of  the  identification  tech¬ 
niques.  Recall  that  the  derivatives  in  Equation  (2.9)  are  expressed  as  third 
degree  polynomials  in  forward  speed  U.  ,  i.e.. 


moe(u) 
%  (“) 


a /  u 


7T 


>r?A  (u)  =  aj  7T 


where 


hla> 


£  aT7 

it, 


(*,  u*, 


Define  t’  .e  parameter  vector  <p  to  be 


(ai  j  j  *  *  *  >  an  ) 


and  the  state  x  and  the  control  vector  m  to  be 


=  (<l  *  6  ,  «  , 

-  (A\  ,  AV  ,  A<Tfs  )' 


(2.  10) 


(2.  ID 


(2.  12) 


(2.  13) 


(2.  14) 


respectively.  In  view  of  the  fact  that  the  model  (2.  9)  is  by  no  means  perfect, 
dynamic  modeling  errors  and  possible  unknown  external  excitations  are  sim¬ 
ulated  by  unknown  forcing  inputs,  ur(t)  .  The  equations  of  motion  (2.9)  may 
now  be  alternatively  written  as: 


%  =  -f  (y, ,  ,  /»)  +  gf  ur  It)  ,  *{o)  •  %c 


(2. 15) 


where  p0  is  the  unknown  initial  condition,  g  -  I^} 
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-  m  (u)  +  m  iu)Aur  *  m >  (u,)Aq  *  mlu)Ak  +  m  (u)  AB  *  (u)AS 

w  r  A  O  *5 

*  (%,-P,  m)  = 

Xo  <-«•'  *  (U.)  Aur  -r  x.k(*)AK  *  *1 b(cc)A8  +*s  (u)AScs  -  q  ur  -  q  Sw  & 

-  h  -u-  *  }u  (U)A*  *  §k(u^Ak  *  3s  (U'>A'B  *  (u~)A<r£S  *  qu  *■  qcos  9 

(2.  16) 

and  r 

urlt)  -  I  urt(t)  ,  o  ,  ur3(t)  ,  ^  (t) ij  (2.  l?) 

jfe 

Consideration  has  also  been  given  to  the  simulation  of  random  gusts. 

Denote,  for  convenience,  the  acceleration  vector  to  be 


,  *  a 

A,  («,  it)  = 


— 1 

rf* 
_ ) 

71 

3 

^4  - 

-L  (u,  ■*  qus)  f  sin  6 
~L  (us  -  q.  u)  -  co s  8 

4 


(2. 18) 


*  If  gusts  are  considered,  q  is  the  gust  effectiveness  matrix  and 
ur(i)  is  a  gust  vector,  i.  e. , 


9,  r  9/  = 


f  *%(«>  o  muLu)  (u) 

j  0  O  0  o 

I  o  0  %a  (u)  a '.^(U) 


>  us(t)  - 


(*)  3ur  (*)  J 


where 


mu  =  “d  a>  *  Aur  *  H  a3  +  a4  +  A  Scs  a5  *•  A  A  a4  J 
%  =  “rf  ^  +  Aus  a.a  +  A3  a,  *■  A<^s  /zw  ^21^] 

j>  -  Aar  *„  "  AS  21  A  **] 

tTr  =  (C  ,  I  ,  2.u  ,  3  «*) 
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W  may  now  formulate  the  problem  of  identifying  V/STOL  aircraft  param¬ 
eters,  the  unknown  initial  state,  and  the  unknown  forcing  inputs  as  follows: 


Given:  (a) 
(b) 


the  nonlinear  dynamic  system  (2.  15) 
a  set  of  discrete  measurements  for  the  state  and  the 
accelerations,  which  are  corrupted  with  measurement 
noise  V,  (*;)  ,  and  (*/)  ,  respectively. 


*  *  (V  *  r;  (*,)  "1 

hi  =  h,  (* 


i  - 


(2.  19a) 
(2.  19b) 


(c) 


a  set  of  discrete  measurements  for  the  control  vector 

w  (*i)  t  *■  = 


Find;  the  unbiased,  minimum  variance  (efficient)  estimates  for 
and  ur(£J  ,  i  =  /,  2 ,  . ..  ,  A/ 


(1) 


A  few  comments  concerning  the  above  formulation  are  now  in  order: 
By  annexing  the  parameter  vector  to  the  state  vector  x  ,  i.  e.. 


(2.20) 


*  For  current  instrumentation  on  the  X-22A,  there  is  no  sensor. 
Consequently,  measurements  from  the  ac  vane  sensor  are  utilized. 
In  this  case,  the  measurements  are  nonlinear  functions  of  the  states: 

-  /  US'-  Q  / 

=  tan  - - —  +  noise,  where  a.u  is  the  (&  vane  measurement. 

The  vane  is  located  at  J  ft  ahead  of  c.g.  of  the  aircraft. 
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it  is  readily  seen  that  Equations  (2.  15)  and  (2.  19)  can  be  rewritten  as 


0  \  [  0 


y. - 


,  *-*  (0)  -  % 


^LLL  Lai 

.  %  J  _  vt+h*r' 


(2.21a) 


(2.21b) 


where 


H  (t,  m)  = 


(u)n<r  f  i c  (u)AQ  *  X.(u)A>< 

‘yj  *S  “  A» 

3c (u)  *  UuUu/  *  3*Ju)Hs  *  h(u)68  +  h(u)AK) 

ff\  (u)+  m  (u)Aur  *  m  (u)  AS  +  /na(u)A3+  m  fu)Aa  +  m.  (WdA. 
ur  <>  «  s  <t  T  A 


~  0  o  l  o  ~ 

g  =  o  o  o  i 

_  i  o  oo 


From  Equation  (2.21)  we  see  that  the  problem  stated  above  can  now 
be  restated  as  follows:  Giver,  (a),  (b),  and  (c),  find  the  best 
(efficient)  estimates  of  %a  and  ar(t;)  ,  i -  f,  2,  ... ,  V. 


Regardless  of  the  statistical  properties  (or  more  precisely,  the 
cond;  ional  probability  density  function) 


*(**»  I  %  >  %  t  '  *  *  %)  “  *(*».!  Vl*>) 

+  iurL  j  Y( "))  ,  c  =  f,  2, ...  .V 


(2.22a) 


anu  +iar£}Y("))  ,  t  =  f,2 . V  (2.22b) 

a  best  (efficient)  estimate  for  the  above  problem  is  the  conditional 
expectation  of  (2.  22a)  and  (2.  22b),  i.  e.  , 


<E{tfclYlN)) j 


(2.23a) 


(2.23b) 


This  is  shown  in  .Appendix  G. 
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I 


(3)  If  the  statistical  properties  of  ,  ur(t) ,  and 

V(t)«  ( vj(t)  I  yrt T(i}*[gz  ir[t) ] r  j T  are  known,  and  if  they  are 

formally  distributed  such  that 

E  l\l  '  \ 


a 

o 


and  urlt)  and  v(t)  are  zero  mean  with  covariance  matrices 


E  (ur(t)  urr(V  j 
£  (i/  ^ 

£  vT  (T)} 


*  <?(t)  /ft-f) 

*  p(r<t(t-T) 

-- 


respectively,  then  it  has  been  shown  (References  4-7)  that  the 
maximum  likelihood  (Bayesian)  fixed-interval  smoothed  estimate 
of  Vfl  (t)  for  given  the  data  tjtt)  ,  0  4  t  ±  is 

equivalent  to  minimizing  the  cost  functional 


J  ■  f  d,\ 

<  o 


(-1.24) 


with  respect  to  ur(t) ,  0  *  t  *.  ,  subject  to  the  constraint  in 

Equation  (2.  21a),  where 


Ct)  = 


Iv) 


(j  -  h  (%a  ,  m) 


A?  4 


L  C'(t) 


/£  ('J')  J 


<?  * 


?  i  o  1 

lVIV.! 


(2.25a) 


(2.25b) 


and  H*ll*  4 

It  should  be  emphasized  that  unless  (2.21)  is  linear,  the  fixed-point 


17 


smoothed  estimate  x  .  as  stated  in  comment  2.  does  not 

* 

necessarily  lie  on  the  fixed-interval  estimate  as  formulated  above 
at  time  t  -  0.  This  has  been  pointed  out  by  Cox  in  Reference  5. 

(4)  As  will  be  discussed  later  in  Section  V,  the  a  priori  information 
P<i  for  the  unknown  parameter  is  almost  always  lacking.  If 
in  addition  to  the  lack  of  the  a  priori  information  »  the  process 
noise  is  also  absent,  then, for  the  discrete  measurements  con¬ 
taminated  with  Gaussian  noise  where 

£  (m)  ■  --  o 

E  {^W=  )T1  *  lifij 


the  likelihood  function  becomes 


"  2 

/.,  f(run\t  >  -  * c  ~'l  If.-K *„.*)!!  .  (2.26) 

i  i 

where  C  is  some  positive  constant  independent  of  xa  . 

o 


Thus,  the  classical  (non- Bayesian)  maximum  likelihood  estimate 
for  has  the  same  cost  functional  as  what  is  commonly  called 

a  measurement  (or  output)  error  method.  The  latter  will  be 
discussed  in  the  next  section. 
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Figure  2-1  Constant  Attitude  Slow  Level  Transition  -  X-22A  (  Q 


SECTION  HI 


REVIEW  OF  IDENTIFICATION  TECHNIQUES 

Parameter  identification  has  been  playing  one  of  the  major  roles  in 
the  field  of  physical  science  and  engineering.  Literally  hundreds  of  papers 
and  reports  have  been  devoted  to  this  subject.  Since  the  V/STOL  parameter 
identification  problem,  as  formulated  in  the  preceding  section,  is  basically 
a  nonlinear  estimation  problem,  attention  was  therefore  focused  on  those 
methods  which  are  directly  applicable  to  nonlinear  systems  or  which  can 
readily  be  extended  to  nonlinear  systems. 

Perhaps  due  to  poor  communication  among  the  various  authors,  much 
work  has  been  duplicated  and  triplicated;  each  author  often  has  coined  a 
different  name  for  basically  the  same  technique.  For  an  uninitiated  engineer 
it  would  be  a  big  job  indeed  to  sort  out  which  technique  is  the  most  suitable 
for  his  problem.  The  first  important  point,  then,  is  to  recognize  that  the 
many  available  parameter  identification  techniques  may  be  classified  into 
three  major  groups,  as  follows: 

1.  Equation-error  methods  (or  process-  ,ror  methods), 

2.  Measurement-error  methods  (or  response-error  methods), 
and 

3.  Methods  treating  both  measurement  and  process  errors. 

As  shown  later  in  the  report,  equation-error  techniques  give  biased 
estimates  in  the  presence  of  measurement  noise,  but  they  are  noniterative 
and  hence  the  simplest  for  parameter  identification  from  a  computational 
point  of  view.  Furthermore,  this  group  of  methods  is  equally  applicable  to 
both  linear  and  nonlinear  systems.  The  response-error  methods  are  iterative. 
Although  these  methods  giv*"  unbiased  estimates  in  the  absence  of  process 
noise,  they  generally  produce  biased  estimates  of  the  unknown  parameters  in 
the  presence  of  process  noise.  Again,  these  methods  are  equally  applicable  to 
linear  and  nonlinear  systems.  The  third  group,  which  treats  both  the 
measurement  and  process  errors,  has  the  capability  of  obtaining  unbiased 
estimates  in  the  presence  of  process  noise  and  of  estimating  the  unknown 
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forcing  inputs  (or  the  process  errors),  thus  providing  an  indication  of  the 
errors  in  the  dynamic  model  assumed. 

Although  the  methods  in  the  third  group  are  undoubtedly  the  most 
suitable  for  use  in  parameter  identification  of  V/STOL  aircraft  because  of 
the  capability  of  detecting  the  modeling  errors,  it  is  felt  appropriate  at  this 
point  to  examine,  in  some  depth,  the  basic  characteristics  of  all  the  three 
groups  as  stated  above.  In  was  with  a  clear  understanding  of  the  merits  and 
debits  of  these  available  techniques  that  a  final  technique  for  the  parameter 
identification  of  V/STOL  aircraft  was  developed  as  discussed  in  Section  V. 

3.  1  Equation-Error  Methods 

The  equation-error  methods  for  aircraft  parameter  identification  may 
be  conveniently  classified  into  two  categories: 

(a)  Methods  which  use  the  acceleration  measurements  in 
addition  to  the  state  variable  measurements. 

(b)  Methods  which  use  only  the  state  variable  measurements. 

Under  category  (a),  only  the  so-called  "equations-of-motion  (error)  method" 
(References  8,  9,  and  10)  was  considered  here.  Under  category  (b),  three 
methods  were  studied.  They  are: 

(i)  Modified  spline  function  method  (Reference  11). 

(ii)  Polynomial  estimator. 

(iii)  Denery's  method  (Reference  12). 

There  are  many  more  methods  of  the  integral  transform  variety  available  in 
this  category;  however,  since  frequency  domain  techniques  are,  generally 
speaking,  not  readily  extended  to  nonlinear  systems,  the  integral  transform 
methods  were  not  considered  in  this  report.  Some  statistical  properties  of 
the  equation  error  methods  are  discussed  in  Appendix  B. 
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Equations-of-Motion  (Error)  Method  (References  8-10) 


This  method  was  originally  developed  in  CAL's  Flight  Research 
Department  for  conventional  airplane  identification.  It  is  essentially  a 
classical  linear  regression  method  and  a  general  discussion  of  the  method 
is  given  below  as  applied  to  VTOL  aircraft  identification. 

F rom  Equation  (2.  15)  and  (2.  19),  i.  e.  , 

X  *  f  (x,  p,  ?»)  *■  ur(t)  (2.  i.5) 

^  (2.19a) 

fa  *  h,  (x.,x)  +  tr2(t)  (2.19b) 

where  2  =  the  state  vector  for  our  problem,  (4-vector) 

■p  -  the  unknown  parameter  vector  (q-vector) 

=  state  measurements  (4- vector) 
fa  -  measurement  of  the  accelerations  (3-vector) 
w  =  control  vector  (  r-vector) 

=  error  vectors 


It  is  desired  to  estimate  the  parameter  vector  that ’s  the  best  fit  to  Equation 


(2.  15),  in  the  least  squares  sense,  using  a  set  of  data 
Z,(N)  =  (*a)  ,  fa,  (*,)»  ■■■■>%  (**)*  — »  %  (**■>  ?/♦  (*')>  ***  fai 

Zz(N)  -  \^21  ^  'Tl‘3  faffed’  '  " 

M  (t/)  *  [*,  (t0)  t  (t,) , w,  (tN) mr(tc) y  yr>r(t1))...  ynr  (fyjj 


(3.1) 


Since  ^  enters  into  the  vector-valued  function  f  linearly,  the 
substitution  of  the  above  set  of  data  (3.  1)  into  (2.  15)  results  in  a  set  of 


3  (  N  +  1  )  linear  equations 

?2(N)~kHi>  +  ur(N)  (3.2) 

where  AN  is  a  3  (  M  +  1  )  x  $  constant  matrix  consisting  of  data  2,(N)  and  M(n) 
and  (ic),  •••)  trf (£»)>•■• ‘A/y  (tv) J  • 
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Let  us  assume  that  AN  is  non-stochastic.  Actually,  is  obviously  stochastic 
because  Z,  (N)  is  a  random  vector  for  t  0.  Therefore,  our  assumption  here 
is  only  an  approximation,  l  or  details  see  Appendix  B>  Let  us  further  assume 


that 


E 

C-0V 


E  j^ur(N)J  =  0 

fur(n)j= 


ezL 


3  (M*  t) 


Then  the  problem  posed  above  becomes  a  simple  classical  linear  regression 
problem  with  non-stochastic  regressor  (  ).  The  least  square  solution  to 

(3.2)  is  _  ,  r 

and  the  covariance  of  *p  is 

tov(£)  =  q2(An  A^)'1  (3.3a) 

z 

Since  e  in  the  above  equation  is  usually  not  known  in  practice,  it  has  to  be 
first  estimated  in  order  to  obtain  a  covariance  of  the  estimated  parameter 
using  (3.  3a).  To  do  this,  let  us  consider  the  error  vector  of  the  fit. 

Q  -  Z2(H)~ 

where  Z2  (H)  =  (-jo).  Thus, 

6 


Using  Equation  (3.  3),  it  is  readily  shown  that  the  above  equation  becomes 

=  MuT(n) 

where  M  A#  .  It  is  easy  to  show  that  M  -  tf1  and  MZ  =  nA  ,  and 

hence  the  error  sum  of  squares  becomes 

GT6  =  ur(N)TMTM ur(N)  - uTt(h) Mur(ti)  ( 3 .  3b) 

Thus,  since  M  is  non-stochastic  by  the  virtue  of  th  ;  assumption  that  is 
non-stochastic  and  since  the  trace  operator  is  a  linear  operator,  it  can 
readily  be  shown  that 
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£l{erlj  =  Mur(N)j 

=  tr  £[/Wa/vrj 
=  c2  tr  M 
=  (5  2  [3  (*/+/}-$] 

We  may  therefore  approximate  5^  by 

*•  T  * 

£2  =  6  € 

3(N  +  f)-q,  (3.3c) 


and  thus,  using  (3.  3a)  and  (3.  3c),  an  approximate  estimate  of  the  covariance 
of  the  estimated  parameters  can  be  written  as 


Ce/  / -p)  - 


3(N*-i)-q, 


(3.3d) 


It  should  be  emphasized  that  the  above  relation  is  based  on  the  assumption 
that  A^  is  non-stochastic.  Some  problems  associated  with  this  basic  assumption 
are  discussed  in  Section  V. 


Using  (3.3),  both  the  linear  and  nonlinear  representations  of  the 
VTOL,  aircraft  dynamics  in  transition  were  programmed  for  digital  computation. 
As  an  example,  consider  the  nonlinear  representation  for  the  pitching  moment 
equation  in  Equation  (2.  8) 

\(l)  =  Tn0(u)  +  rn,^(a)^ur*7n^(u)^*}ng(u)bS-*  (u)A5£9  +nx(u)A%  (3  ^ 

where  rnQ  (u)  etc.  are  third-order  polynomials  in  u.  and  huf  ul(t)  -  of#  (t)  ,  and 
where  the  subscript  (?  denotes  the  reference  values. 


Using  (3.3),  (3.4)  becomes 


■p = (aIaj1aI  <?  =  ptAli 


(3.5) 


The  linear  representation  is  obtained  by  setting  /L^  (*)  -  constant  and  ^  =  0 
m  Appendix  A. 
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Modified  Spline  Function  Method 

A  spline  (see  Reference  11)  is  a  thin  strip  that  is  bent  so  as  to  pass 
through  a  given  set  of  data  points.  Using  the  deformed  strip  as  a  guide,  a 
line  can  be  traced  through  these  points;  the  resulting  curve  is  continuous 
and  has  a  continuous  first  derivative.  Analytically,  a  spline  function  is 
usually  generated  by  minimizing  the  integral  of  the  curvature  of  the  entire 
function  subject  to  the  constraint  that  the  function  passes  through  all  the 
data  points.  Ir  this  construction  scheme  it  is  further  assumed  that  the 
functions  and  th**;r  first  t  o  derivatives  are  continuous  within  the  set  of 
data  points. 


In  many  practical  situations,  the  data  are  contaminated  with  some 
random  errors  (such  as  quantization  errors  or  measurement  noise).  Con¬ 
sequently,  it  becomes  desirable  to  relax  the  constraint  that  the  conventional 
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spline  function  must  pass  through  the  data  poin.s.  The  resulting  function  is 
called  a  modified  spline  function  (also  called  floppy  spline  function).  A  scheme 
to  generate  a  modified  spiine  function  has  been  developed  by  D.  Larson  and 
J.  Fleck  of  CAL,  and  has  been  reported  in  detail  in  Reference  11.  They  also 
developed  a  computer  program  for  generating  the  modified  spline  function 
using  the  technique  they  developed. 

When  this  computer  program  is  used  to  perform  as  an  initial  esti¬ 
mator  for  parameter  identification,  the  measured  state  variable  data  and 
weights  are  read  in.  The  spline  routine  uses  these  data  to  fit  a  floppy  spline 
curve  through  the  measured  data  points  of  each  state  variable,  and  then 
evaluates  the  resulting  curve  and  its  time  derivative  at  each  of  the  desired 
time  points.  Once  all  of  the  derivatives  of  the  state  variables  are  known, 
the  initialization  routine  uses  the  least  squares  technique  to  obtain  the  initial 
estimates  of  the  parameters. 

Polynomial  Estimator 


This  method  also  uses  only  the  measurements  of  the  state  variables. 
First,  the  state  variables  are  fitted  with  a  polynomial  in  t  using  a  least 
square  method.  The  time  rates  of  the  changes  of  the  state  variables  are  then 
calculated  from  the  polynomials  used  to  fit  the  state  variables.  The  equations- 
of-motion  error  method  is  then  applied  to  obtain  the  estimates  of  the  unknown 
parameters. 


Like  the  preceding  two  methods,  here  we  also  assume  that  all  the 
state  variables  are  measurable.  For  computational  simplicity,  ail  the  state 
variables  are  represented  by  polynomials  of  the  same  degree.  Consider  the 
linear  representation  of  the  VTOL  aircraft  dynamics. 


£  =  Ft,  +  Om 


cj  -  %  +  ir 

y,  -  (a  ,  0 ,  u.,  w) T 

w  >  &  T 


(3.6) 
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We  fit  a  set  of 
Let 

where 


n-degree  polynomials  to  these  state  variables'  measurements. 


A 


b 


/  aio 

*,1 

•*  d/n 

av 

, 

• 

\  ^*0 

• 

(t°  t'  *2  1 1”) 

9  *  f  •  •  •  f  L  /. 


(3.  7) 


At  each  time  instance  i ■ 


(j  (tt)  -  Ab(£;). 


Hence 

yfa),  •••»  {/(**)]  ~  A  [b(0,  b(t ,),■■■>  b(i„jj 


or  5  =  A  2  . 

Thus,  in  a  least  square  sense,  A  is  given  by 
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We  now  substitute  (3.7)  into  (3.6);  the  result  is: 
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L  •  J  j  m  j 

^  squares  method,  ws 

[F;a]  ■  tAZ)r;Mi|[^]  [w'H } 


Once  again,  using  the  least  squares  rnethod,  we  have 


13.  8) 


(3.  9) 
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Equation  (3.9)  is  the  desired  result.  It  is  to  be  noted  that  like  the 
preceding  two  methods  this  approach  is  also  applicable  to  nonlinear  systems. 

Denery's  Initial  Estimator  (Reference  12) 

This  method  of  performing  the  initial  estimation  of  the  unknown 
parameters  was  recently  developed  by  D.  Denery.  Its  special  feature  is  its 
similarity  to  the  method  of  quasilinearization,  which  we  shall  discuss  later. 
Thus,  a  unifier,  estimation  procedure  can  be  used  for  first  obtaining  the 
initial  estimates  and  then  subsequently  improving  these  estimates  through 
further  iterations.  However,  this  method  is  applicable  only  to  linear  systems. 

The  basic  idea  of  this  method  is  to  relate  the  unknown  parameters 
of  the  system  to  a  set  of  new  parameters  that  affect  the  output  in  a  linear 
fashion.  In  so  doing,  linear  regression  can  then  be  used  to  obtain  this  set 
of  new  parameters  which,  in  turn,  permit  the  c;  '  lulation  of  the  original 
unknown  parameters  using  the  relationship  between  these  two  sets  of  param¬ 
eters.  Details  are  discussed  in  Appendix  C. 

3.1.1  Comparison  of  the  Numerical  Results 

The  equations-error  methods  discussed  in  3.  1  were  programmed 
for  digital  computation  using  the  linearized  equations  of  motion  of  the  VTOL 
aircraft  dynamics,  which  describe  the  fixed-ope rating  point,  fixed-duct  angle 
motions  of  the  \  ehicie  (see  Appendix  D,  Equation  D.2a).  The  results  of  the 
computer  runs  are  shown  in  Tables  3-1  through  3-4.  The  data  used  are 
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explained  in  Appendix  D.  From  these  numerical  experiments,  the  following 
observations  may  be  made: 

(i)  For  data  without  measurement  error  (Data  1-0),  the 

equations-of-motion  method  and  Denery's  method  give  the 
correct  parameter  estimates.  However,  the  polynomial 
estimator  and  the  modified  spline  function  method  do  not 
obtain  the  correct  estimates. 

(ii)  As  the  noise  to  signal  ratio  increases,  the  estimates  of  all 
four  methods  deteriorate,  confirming  the  statistical 
analysis  conducted  in  Appendix  B. 

(iii)  Although  for  noiseless  data,  Denery's  method  gives  the 
correct  estimates  regardless  of  nominal  values  of  the 
parameters  and  Gs  that  have  been  assumed  (see 
Appendix  C),  for  noisy  data  the  estimates  are  significantly 
affected  by  the  values  of  and  GN  used. 

(iv)  The  estimates  using  the  polynomial  estimator  depend 
heavily  upon  the  degree  of  polynomial  assumed  for  the  state 
variables.  The  numerical  results  suggest  that  the  higher 
degree  polynomial  fit  (ninth  degree)  is  more  accurate  than 
the  lower  degree  (fifth  degree).  However,  the  estimates 
for  the  ninth  degree  fit  do  not  appear  to  be  better  than 
those  using  the  modified  spline  function  method. 

(v)  From  the  computational  point  of  view,  the  equations-of- 

motion  method  is  the  simplest,  provided  that  the  acceleration 
measurements  are  available;  Denery's  method  is  the  most 
complicated  one,  in  that  it  requires  solutions  of  a  large 
number  of  sensitivity  equations. 

3.  1.2  Concluding  Remarks  on  the  Equation-Error  Methods 

From  the  above  discussions  and  the  numerical  experimentations 
the  follow ir g  remarks  are  in  order. 


fl 


l 


2? 


(1)  It  has  been  shown  (Appendix  B)  that  the  initial  estimators 
discussed  in  Section  3.  1  are  asymptotically  biased,  i.  e.  ,  the 
use  of  longer  data  records  does  not  help  reduce  the  bias  of 
the  estimates. 

(2)  A  formula  has  been  derived,  for  the  linear  case,  for  the 
calculation  of  the  bias  when  the  equations-of-motion  method 
is  used  to  obtain  the  initial  estimates  and  if  the  noise  is 
normally  distributed.  (See  .Appendix  B). 

(3)  If  the  acceleration  measurements  are  available,  then  the 
equations-of-motion  method  if  recommended  for  initial 
parameter  estimation,  since  this  method  is  applicable  to 
both  linear  and  nonlinear  systems,  and  since  its  computa¬ 
tional  procedure  is  the  simplest.  If  the  acceleration 
measurements  are  not  available,  then  the  modified  spline 
function  method  is  recommended. 

(4)  For  linear  systems,  Denery's  method  is  a  good  alternate 

to  the  above  two  methods,  since  its  computational  aigorithm 
is  similar  to  the  method  of  quasilinearization,  and  a  single 
computer  program  can  therefore  be  easily  devised. 

As  stated  at  the  beginning  of  Section  III,  in  the  absence  of  process 
noise  the  measurement-error  methods  will  remove  the  bias  in  these  initial 
estimates  obtained  using  equation-error  methods.  The  iterative  measurement- 
error  methods  such  as  quasilinearization  method,  the  extended  Kalman 
filtering  method,  and  the  conjugate  gradient  technique  are  applicable  to  both 
linear  and  nonlinear  systems.  For  linear  systems  there  appear  to  be  other 
methods  that  are  capable  of  removing  the  bias  of  the  initial  estimates.  From 
the  statistical  analysis  performed  in  Appendix  B,  it  is  clear  that  these 
methods  may  be  classified  into  the  following  two  groups: 

(a)  Estimate  the  noise  statistics  and  remove  the  effects  of 
the  noise  from  the  regressor  (Reference  13). 
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(b) 


Introduce  a  set  of  "instrumental  variables"  (see  References 
13,  14,  and  15)  which  make  the  resuiting  regressor 
uncorrelated  with  the  errors  in  the  least  square  fit.  (See 
discussion  in  Appendix  E.) 

3.2  Measurement-Error  Methods 


We  now  proceed  to  examine  the  basic  characteristics  of  the  second 
group  -  the  measurement-error  methods.  As  we  stated  in  the  comment  at 
the  end  of  Section  II,  this  group  of  methods  essentially  employs  the  likelihood 
function  for  the  system  (including  additive  white  Gaussian  measurement  noise) 
as  the  performance  index.  Indeed,  from  (2.  26)  it  is  clear  that  maximizing 
the  likelihood  function  Ik. -r  ( Y(N)jx.0)  is  equivalent  to  minimizing  the  deterministic 
cost  function 


(3.10) 


Therefore,  from  the  statistical  point  of  view,  the  estimate  of  the  initial 
augmented  state  -pT)T  obtained  from  minimizing  (3.  10)  is  the 

classical  (non-Bayesian)  maximum  likelihood  estimate  for  the  initial 
augmented  state  of  a  continuous  system  with  discrete  measurements  corrupted 
by  additive,  white,  Gaussian  noise.  From  a  deterministic  point  of  view,  the 
minimum  of  the  cost  function  used  in  this  group  of  methods  is  the  sum  of  the 
weighted  least  squares  in  the  output  errors. 


For  analytical  simplicity,  we  shall  consider  (3.11),  which  is  the 
equivalent  continuous  counterpart  of  (3.  10),  for  use  as  the  performance 
index. 

r 

7  */ 2'1  \y(i}-h(%,ptin}\dt  (3.11) 

o 

Th'.  problem  for  this  group  of  methods  can  now  be  stated  as  follows: 
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Given: 


(1) 


a  continuous  nonlinear  dynamic  system  (2,  15)  with 
&(*)  =  o*.  and  a  set  of  continuous  measurements 
q  (t)  ,  C  £  t  £  as  given  in  (3.  12a)  and  (3.  12b) 


%  =((*,?,*>)  ,  *(o)  =  %0 

y(i)=h  (z,  p,m)  + 


(3,  12a) 
(3.  12b) 


respectively,  where  £  \v(t)  J  =  0,  and 
E{v(i)irT(z)]  =  Z(i)S(t-i). 


(2) 


a  set  of  noise  free  continuous  measurements  for  the  control 
vector  m(t) ,  0 


Find: 


An  estimate  of  the  parameter  vector  and  the  initial  state 
that  minimizes  (3.  11) 


For  sake  of  generality  in  the  following  discussion,  let  x,  be  an  n-vector, 
f)  be  a  q-vector,  and  tj  an  m-vector. 


3.2.  1  Description  of  Various  Measurement-Error  Methods 


Clearly,  the  problem  posed  above  ’ ~  essentially  a  nonlinear 
parameter  minimization  problem,  for  which  many  iterative  methods  are 
available  to  obtain  a  solution.  In  this  report,  the  following  methods  are 
discussed. 


1. 


2 . 

3. 

4. 


Quasiiinearization  (Differential  correction,  parameter 
influence  coefficient,  Gauss-Newton  procedure, 
"Modified1'  Newton-Raphson). 

Gradient  methods  and  their  simplified  computation. 

Basic  Newton's  procedure  and  Goodwin's  simplifications, 
Conjugate  gradient  method. 


Discussions  will  be  given  later  on  the  effect  of  the  process  noise  on  the 
estimates  from  this  group  of  methods. 
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5.  Method  of  invariant  imbedding  (for  case  without  process 
noise) 

6.  Extended  Kalman  filter  (for  case  without  process  noise) 

A  sketch  of  these  methods  will  first  be  given.  This  will  then  be  followed  by 
an  examination  of  the  basic  characteristics  of  this  group  of  methods.  Their 
merits  and  debits  will  then  be  assessed,  based  on  the  computational  com¬ 
plexity  as  well  as  from  the  results  of  numerical  experiments  using  computer¬ 
generated  data. 

Quasilinearization  Method  (References  16  -  18) 


This  method  is  also  referred  to  as  Gauss-Newton  procedure  (Refer¬ 
ence  19),  parameter-influence-coefficient  method  (Reference  i9),  "modified" 
Newton-Raphson  method  (Reference  20),  etc.  It  begins  with  the  linearizations 

A  A 

of  the  trajectory  and  the  output  about  the  initial  estimates  and  V0  : 


*(t0  +  A*e  *  -P  '  V)  *  *  (\tP) 


h  ('Z,  p,  m]  a  h  {'Z('Z0  ,  p),  + 


dh 
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2 A  . 

(3.  13) 


4  hi  hh 


J  Pp  (3.14) 


The  sensitivity  matrices  and  are  obtained  from  the  solu¬ 

tions  to  the  following  set  of  linear  time -varying  differential  equations: 
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(3.  16) 
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where  ln  is  the  order  identity  matrix.  From  (3.  11)  the  gradient  of  the 
performance  index  with  respect  to  the  initial  state  and  the  parameter  is 

iT 


Vt  £ 


jV 

1 

1 

dt 

dh 

-  + 

dh 

- 

_ 1 

) 

dp 

9* 

dp  . 

e'1  (y(t)-h(x,  p,m))  dt. 


(3.  17) 


Using  (3.  14)  and  equating  the  gradient  V '<!#  in  (3.  17)  to  zero  which  defines 
the  extremal,  yields  a  new  estimate 


(**) 

“  ntiu 


(K) 


old 


A  x. 


(3.  18) 


where 

At 


*0  ' 


L  ap 


dh  3t 

d*  dx , 


dh  dh  dx 
dp  dx  dp 


-,r 


e  '  \J*L  —  !  w  ,  9 A  $4 

\.?x  d%o  j  2p  34  pp\ 
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dh  d*  \  dh  ^  dh  2t 


-X 


dx  dx0  j  dp 


dx  dp 


e’1  (y  (*)  -  h (Z  ,  p n  m))  d-t 


(3.  19) 


The  Jacobian  matrices  in  (3.  15)  and  (3.  16),  3h/gx  ,  ^hi/pp  in 

(3.  14),  and  the  computed  output  h(y,p,m)  are  evaluated  at  the  old  estimate 
)old  ♦  Note  also  that  t(x6.  Ip)  =  *[(4*0)c/g/]  in  ^3* 13^  is  the  solution 
of  (3.  12a)  using  (k &0)olci  • 


It  should  be  pointed  out  that,  when  acceleration  measurements  are 
not  used,  h  is  not  a  function  of  -p  and  hence  ^^Idp  =  0  in  (3.  17)  and 
(3.  19). 


In  the  above  derivation  for  the  improved  estimate,  there  is  no 
guarantee  that  (3.  18)  will  converge.  It  has  been  a  common  practice  to  use 
a  positive  number  cC  ,  0  <  OC  A  1  to  reduce  the  magnitude  of  the  correction 

(3.2°) 

whenever  any  element  of  Axa  is  large  in  magnitude  compared  to  its  cor- 

o 

responding  (%a  o  )  ^  .  An  alternate  scheme  is  to  determine  oC  by  a  one¬ 

dimensional  search  such  that 
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(3.21) 


■s. 


I 


rather  than  using  a  predetermined  value  such  as  0  <  C£  1. 

We  mention  in  passing  that  (3.  19)  can  oe  used  as  the  basis  for  a 
recursive  computational  scheme  (Reference  21). 


min  T 
ot  J 


Gradient  Method  (References  22  and  23) 

The  gradient  method  is  basically  a  linearization  on  the  performance 
index  with  respect  to  the  parameter  vector,  that  is: 

J  '  A\i  '  J (\ > -  [\ J 'i J  \  (-’• 

with  a  constraint  on  the  step  size  2)  V-q.  given  by: 

^  =  T  (J  \  )  5  ^'4,)  (3.23) 

where  C  is  a  chosen  constant,  and  S  is  a  positive  definite  symmetrical 
matrix. 


Introducing  a  Lagrange  multiplier  \  ,  and  setting  the  gradient  of 
J  (^a.)  =  0,  where 


yields 


?  )  =  J"  k  [C  ~  i  (**>■  f  s  )] 


(3.24) 


where  the  gradient  J  in  (3,  24)  is  given  by  (3.  17). 


The  evaluation  of  the  gradient  of  the  performance  index  can  be  ob¬ 
tained  more  efficiently  by  a  use  of  an  adjoint-variable  method.  However,  we 
shall  not  discuss  it  here.  (See  Reference  22  for  details.) 
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Newton's  Procedure  and  Its  Connection  with  Quasilinearization 
(References  19  and  20) 


The  basic  Newton's  procedure  is  to  first  expand  the  performance 

A 

index  (3.  11)  in  a  Taylor  series  abojt  the  old  estimate  . 

J(%A*A%a)  -  3  (iaa )  *  +  J 

where  T~  x  is  the  curvature  matrix,  and  higher-order  terms  have  been 
Ao  tLo 

neglected.  By  imposing  the  condition  that  the  gradient  of  the  performance 
index  with  respect  to  the  parameters  and  initial  state  be  zero,  i.e, , 


the  change  in  the  parameter  vector  is  seen  to  be 


=  - 

0 


’wvTv^ 


(3.  26) 


The  new  estimates  of  the  initial  state  and  the  parameters  are  then  obtained 
by  using  (3.  27) 


(3.27) 


where  oc  >  0  can  be  obtained  by  a  one-dimensional  search  along  the  positive 
real  axis  such  that  7 ^('^a.0)rT£jt/]  =  min.  Notice  that  a  large  amount  of  com¬ 
putation  involving  second  partials  with  respect  to  initial  state  and  the  param¬ 
eters  is  required  to  obtain  the  curvature  matrix  JL  ~  .  Goodwin 

(Reference  19)  has  simplified  considerably  the  computational  load  by  again 
using  adjoint  variables.  However,  aside  from  the  fact  that  the  computational 
load  is  heavy  to  obtain  the  curvature  matrix,  the  other  major  drawback 
associated  with  Newton's  procedu.  e  is  the  fact  that  unless  the  curvature 
matrix  is  positive  definite,  there  is  no  assurance  of  convergence. 

This  can  be  seen  by  substituting  (3.  26)  into  (3.  25),  which  yields: 


-  j  (\  j)\ cvx<  j) 

A  0  0  * 
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Since  x  *  is  positive  definite  if  and  only  if  J*  is  positive  definite, 

it  is  clear  that  there  is  ro  guarantee  that  J”  will  decrease.  Several  schemes 
have  been  devised  to  partially  overcome  this  difficulty.  All  these  schemes 
involve  the  diagonalization  of  the  curvature  matrix  and  hence  require  a  solu¬ 
tion  of  eigenvalues  and  corresponding  eigenvectors  of  the  curvature  matrix  ~ 
a  procedure  which  significantly  increases  the  computational  load.  We  now 
show  the  connection  of  Newton's  procedure  with  the  quasilinearization  method 
discussed  previously. 

F rom  (3.  17) 
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are  matrices  with  their  ij  and  im  elements  as  shown  in  the  above  brackets 
respectively. 

Now,  if  the  second  partials  are  neglected,  then 
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(3.  30) 


Clearly,  from  (3. -26),  (3,30),  and  (3.  17) 


L<  }  I  i  j  dk  d*  '  2*  3h  ?t  f  dh  at  1  dh  dh  **  1  ) 
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£' '!  (q(f)  -  h  (x,  p.  m )) 


which  is  precisely  (3.  19).  Thus,  if  the  second  partials  are  neglected, 
Newton's  procedure  reduces  to  the  quasilinearization  method  discussed 
earlier. 

Conjugate  Gradient  Method  (References  24  -  26) 

The  conjugate  gradient  method  begins  with  the  construction  of  io.i- 
jugate  gradient  vectors  {dtj  which  have  the  following  property 


a-  o.}  -  0y  i j  t  ifj  s  (3-31) 

^  0 

This  is  then  followed  by  a  sequence  of  one-dimensional  searches  to  obtain 
scalars  such  that 


win  t f ,  \ 

«  7(  v  ^ 


io 


(3.32) 


E  i 


P 


and 


A  •■  f  1  />< 

*».  =*a>*A*-a 


A*a  =  '  */ 


(3,  33} 


In  practice,  the  construction  of  conjugate  gradients  by  (3.  31)  is 
rarely  used,  since  it  requires  the  information  of  the  curvature  matrix 
J*  .  Instead  the  following  construction  scheme  is  used: 


f  V**-’ 

1  II  Vt  j(*a  ^!!Z 

[  **.*«;)♦ 


;  =  i 
i  «2 


(3.34) 


ik.  ?K-‘>ir 

where  the  norm  j|  .  )J  is  the  q  +  r>  -dimensional  Euclidean  norm  (i.e. ,  the 
square  root  of  the  sum  of  the  square  of  the  £  *  r*  -components)  and  the  gra¬ 
dient  V  J(ia  *)  in  (3.  13)  is  given  by  (3.  17). 

d  ^ 

Thus,  the  first  iteration  is  basically  a  gradient  method.  However, 
the  search  directions  in  the  second  iteration  and  iterations  thereafter  use 
a  linear  combination  of  the  gradient  and  the  previous  search  direction.  In 
addition  to  the  simplicity  of  the  algorithm,  it  has  a  good  convergence  pro¬ 
perty.  Indeed, 

d 
del 
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To  show  this,  one  observes  that 
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From  (3.  32)  it  is  then  soen  that 
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Using  the  definition  of 


ft 


it  is  readily  established  that 


The  preceding  four  methods  are  all  nonrccursive  (or  batch  pro¬ 
cessing)  methods;  the  entire  data  set  is  utilized  each  time  the  estimates 
are  updated.  As  a  summary,  we  list  the  information  utilized  in  each  meth¬ 
od  to  obtain  the  correction  term  which  improves  initial  state  and 

parameter  estimates  in  the  following  table: 


Methods 

Information  used  in  correction,  A*- 

o 

i 

i  Quasiiinearization 

Gradient  and  a  modif  ed  curvature  matrix 

[  Gradient  Method 

1 

Gradient  only 

Newton  Procedure 

Gradient  and  curvature  matrix 

Conjugate  Gradient 

Conjugate  gradients 
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We  next  discus.-  l«u  recursive  methods  that  sequentially  update  the 
estimate  of  the  parameter  and  the  current  state  at  each  data  point.  Ihese 
two  methods,  as  do  many  more  nonlinear  filtering  methods,  belong  the 
third  group  of  identification  methods,  in  that  they  may  trec't  both  measure¬ 
ment  and  process  noise.  Clearly,  these  methods  are  equally  applicable  for 
parameter  and  state  estimation  in  the  absence  of  Process  noise,  and  have 
been  chosen  here  to  demonstrate  the  recursive  na  e  of  the  computation. 

We  have  more  to  say  later  in  Section  3.  3  and  Section  V  about  the  estimation 
of  parameters  and  state  in  noisy  nonlinear  dynamic  systems  based  on  noisy 
nonlinear  measurements. 


Invariant  Imbedding  Method  (References  27  and  28) 


Rewrite  (3.  12a)  and  (3.  12b)  in  an  augmented  state  form,  (2.21a)  and 
(2.  2ib)  respectively,  i.e.. 


*vz  “4  (*&>*) 
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Then  the  Jacobian  matrices  ^*!dx  » 
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(3. 35a) 
(3.  35b) 

(3.  36a) 

(3.36b) 


Using  the  invariant  imbedding  technique,  it  can  be  shown  (References  27  and 
28)  that  the  estimate  of  the  augmented  state  is  computed  recursively  as 
follows: 


d 

dt 


(3.  37a) 
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where  the  term 


in  (3.  37b)  is  an  (/*#£)  square  matrix  whose  i^  column  is 

2 


9%- 


(jr-j  Z'ffa-h(*a,*) ) 


Thus,  (3.37b)  can  be  rewritten  as 
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(3.38, 


In  (3.  33),  the  square  bracket  is  an  (rttf)  x  (n*q)  matrix  whose  L  ,  j  element 
is  contained  in  the  braclet.  Note  that  this  termvar.isl.es  if  h  is  a  linear 
function  of  x  .  The  initial  cord’tions  *a  (c),  and  P(o)  -  'PQ  are  usually 
guessed.  For  the  moment  we  shall,  not  dwell  on  the  question  of  how  to  choose 
these  two  initial  conditions.  An  in-depth  discussion  will  be  given  •  n. 

Section  V. 


Extended  Kalman  Filter  (for  the  case  without  procest  noise) 

The  derivation  of  an  extended  Kalman  filter  for  the  noisy  nonlinear 
continuous  system  with  noisy  discrete  nonlinear  measurements  as  formulated 
in  Section  l  is  given  in  Section  5.2.  Here,  for  the  sake  of  comparison  with 
other  methods  discussed  in  this  section,  we  present  a  simpler  version  for  a 
system  without  process  noise  and  with  noisy  continuous  measurements. 

The  name  "extended"  stems  from  the  attempts  which  have  been  made 
to  apply  the  Kalman  filtering  technique  developed  for  linear  systems  to  non¬ 
linear  systems  through  successive  linearization  at  each  data  point. 

Let  %a  ( o >)  be  the  mean  of  xa  (o)  ,  and  P0  ,  £  be  the  covariance 
matrices  of  %a(o)  and  v  respectively,  i.  e., 
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Then  the  estimate  of  the  augmented  state  is  computed  using  (from  References 


29  -  32) 

_d 

it 


(o) 

1  (3.40a) 
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It  can  be  seen  from  (2.  37a),  (3.  38),  and  (3.40)  that  the  invariant  imbedding 
method  and  extended  Kalman  filtering  are  identical  if  h  is  a  linear  function 
of  X  .  It  should  be  pointed  cut  that,  in  contrast  to  the  linear  case, 
equations  (3.40a)  and  (3.40b)  are  coupled  equations,  because  the  Jacobian 
matrices  ^a/di  and  ^hia  are  evaluated  along  the  estimated  augmented  state 
(i)  .  The  decoupling  of  the  variance  (equation  (3.40b)  )  from  (3.40a) 
can  be  achieved  by  evaluating  the  Jacobian  matrices  about  the  trajectory 
computed  using  the  previous  estimated  initial  conditions  of  the  augmented 
state  *a^  .  This  version  of  extended  Kalman  filter  is  equivalent  to  the 

quasilinearization  method,  as  shown  in  Reference  21. 


From  the  above  descriptions  ox  the  various  measurement  error 
methods,  it  is  clear  that  the  conjugate  gradient  method  has  the  advantages 
of  computational  simplicity  and  good  convergence  properties.  The  Newton’s 
procedure  is  the  most  complicated  from  the  computational  viewpoint; 
further,  the  convergence  is  not  guaranteed.  The  gradient  method,  although 
computationally  simple,  has  a  slow  rate  of  convergence  (see,  foi  instance. 
Reference  19).  The  method  of  quasilinearization  has  had  some  encouraging 
applications  in  the  past  (References  12  and  33)  for  the  extraction  of  stability 
and  control  derivatives  of  conventional  aircraft  whose  dynamics  may  be  rep¬ 
resented  by  linear  equations.  It  has  moderate  computational  complexity. 
Numerical  experience  (References  12  and  33)  has  indicated  that  the  rate  of 
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convergence  i3  fast  (quadratic}  if  it  converges  at  ail.  Tbe  sequential  com¬ 
putational  schemes,  as  indicated  earlier,  have  the  capability  of  treating 
both  measurement  and  process  noise.  From  the  computational  point  of  view, 
the  extended  Kalman  filter  is  much  simpler  than  the  invariant  imbedding 
method,  which  requires  the  computation  of  the  second-order  partials.  For 
these  analytical  and  computational  reasons,  it  was  decided  to  numerically 
assess  the  following  three  methods: 

1.  Quasilinearization  method 

2.  Conjugate  gradient  method,  and 

3.  Extended  Kalman  filter. 

However,  before  we  present  the  numerical  results,  it  seems  appropriate  to 
first  examine  the  basic  characteristics  of  this  group  of  methods. 

3.2.2  Basic  Characteristic  of  Measurement-Error  Methods 

From  the  above  descriptions  for  the  various  measurement-error 
methods*  it  is  clear  that  tbe  computational  scheme  of  these  methods  is 
basically  iterative;  the  batch  processing  schemes  are  globally  iterative  and 
the  sequential  methods  are  locally  iterative  by  updating  the  trajectory  at  each 
data  point.  Aside  from  the  iterative  feature,  this  group  of  methods  has  its 
own  associated  statistical  properties.  Furthermore,  there  is  a  problem 
associaced  with  the  uniqueness  of  the  solution.  Let  us  first  discuss  the 
statistical  properties. 

Statistical  Properties  of  the  Measurement-Error  Methods 


In  Section  V,  we  shall  discuss  at  length  the  statistical  properties  of 
sequential  estimation  schemes  such  as  those  discussed  in  3.2.  1.  Conse¬ 
quently!.  we  shall  discuss  here  only  the  statistical  properties  of  the  batch 
processing  methods.  The  following  properties  are  formally  established: 

(i)  If  the  process  noise  ur(t)  (or  modeling  error)  is  absent, 

and  if  the  measurement  noise  is  zero  mean  white  Gaussian 
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as  formulated  in  4.2,  then  the  batch  ..-.ocess  estimates 
are  asymptotically  efficient  (i.e.,  consistent  and  minimum 
mean-square). 

(ii)  If  the  process  noise  I  or  modeling  error)  is  absent,  and 
if  the  measurement  noise  is  nonwhite  (time  correlated) 
but  stationary  and  ergodic,  then  the  batch  process  esti¬ 
mates  are  asymptotically  unbiased. 

(iii)  Regardless  of  white  or  nonwhite  zero  mean  measurement 
noise,  if  the  process  noise  ur(t )  (or  modeling  error)  is 
present,  then  the  estimates  are  asymptotically  biased 

if  the  dynamical  system  and/or  the  measurement  system 
are  nonlinear;  however,  the  estimates  are  asymptotically 
unbiased  if  both  the  system  dynamics  and  the  measure¬ 
ment  system  are  linear. 

The  first  property  is  very  clear,  since  under  the  stated  conditions 
the  estimator  is  identical  to  the  maximum  likelihood  (non-Bayes ian)  esti¬ 
mator  as  explained  at  the  beginning  of  the  Section  3.  2.  Consequently,  the 
assertion  follows  (see  for  example.  Reference  34). 

To  establish  the  second  property,  one  first  noter  from  (3.  19)  that 
the  regressor  is  nonstochastic  (see  Appendix  B).  Also,  as  0  ,  (3. 19) 

implies 
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as  asserted  in  the  second  property. 

To  establish  (iii),  we  note  that>  in  lieu  of  (3.  13)  and  (3.  14),  the 
linearization  about  the  trajectory  b^omes 
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(3. 42a) 


Hence,  in  place  of  (3.  19),  we  have 
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Thus,  the  regressor  is  still  non  stochastic,  but  in  lieu  of  (3.41)  we  have 
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Since  cjur(t)J  =  =  o,  and  since 
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the  assertion  (iii)  is  established. 
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Nonuniqueness  Problem 


All  the  parameter  estimation  schemes  with  a  performance  index 
(3.  11)  are  essentially  methods  for  solving  the  nonlinear  simultaneous 
algebraic  equations 


dJ 


3fi 


o  w 


(3.45) 


Indeed,  equation  (3.  191  i"  essentially  a  scheme  of  solving  equation  (3.45) 
using  Newton's  method  (with  curvature  matrix  simplified).  Since  equations 
(3.45)  are  simultaneous  nonlinear  algebraic  equations  in  the  unknown  param¬ 
eters,  the  existence  of  multi- roots  is  by  no  means  rare;  when  multiple  roots 
are  present,  the  solutions  for  the  unknown  parameters  will  be  nonunique. 
Indeed,  even  for  a  simple  system 


i-  ~a.z+b 


(3.46a) 


where  *  to)  =0  and  a, »  b 
using  data 


are  the  unknown  parameters  to  be  identified. 


-  /-  ^  [e e'U) 


(3.46b) 


and  tf  -  1,  which  resembles  (but  not  identically)  a  first-order  response, 
it  can  be  shown  that  there  are  two  sets  of  solutions  for  a,  and  b  that  satisfy 
(3.45)  in  the  vicinity  of  the  origin.  They  are: 


1.  (Z  -  0 


<z  =  -  1.57 


b  =  0.88 
b  =  1.48 


If  one  begins  with  an  estimate  within  the  domain  of  convexity  of  the 
minimum  (  a  -  -  1.57,  b  -  1.48),  a  use  of  the  quasiiinearization  method 
converges  to  that  minimum.  On  the  other  hand,  if  one  begins  with  a  poor 
estimate,  which  is  within  the  domain  of  convexity  of  the  local  minimum 
(  &■  -  0,  b  -  0.88),  then  the  subsequent  iterations  converge  to  that  local 
minimum.  Results  of  the  computer  runs  are  shown  in  Figures  3-1  and  3-2. 
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3.  2.  3  Numerical  Results  from  Computer-Generated  Data 

For  the  reasons  discussed  at  the  end  of  Section  3.2.  1,  the  following 
three  methods  were  chosen  for  numerical  experimentations  using  the 
computer-generated  data  (see  Appendix  D  for  a  detailed  description).  They 
are: 

1.  Quasilinearization  Method 

2.  Conjugate  Gradient  Method 

3.  Extended  Kalman  Filter 

Digital  computer  programs  were  written  for  these  techniques  using 
the  nonlinear  mathematical  model  chosen  to  represent  the  X-22A  aircraft 
(2.9).  Both  acceleration  and  state  variable  measurements  were  used.  The 
linearized  equations  of  motion  (D.  2)  were  also  programmed  on  a  computer 
for  each  of  these  methods  to  save  computer  time  in  detailed  evaluations. 

Table  3.5  shows  a  comparison  of  the  results  using  the  data  generated  from 
the  linearized  model.  Acceleration  measurements  were  not  used,  and  the 
equations -of- motion  method  was  used  as  the  initial  estimator.  In  perfor¬ 
ming  the  linear  search  (3.  32)  in  the  conjugate  gradient  algorithm,  the  step 
size  was  first  determined  automatically  on  the  basis  of  a  norm  of  the  gra¬ 
dient  (3.  17).  The  linear  search  was  then  performed  by  successively  doubling  > 

the  step  size  until  the  performance  index  began  to  increase.  Quadratic 
interpolation  was  then  applied  to  determine  the  optimal  oc^  .  The  conver¬ 
gence  criteria  used  were:  (i)  change  m  the  components  of  the  parameter, 

and  (ii)  change  in  the  performance  index.  A  similar  procedure  was  applied  j 

i 

to  the  quasilinearization  method  for  the  one -dimensional  search.  j 

For  the  extended  Kalman  filter  runs,  the  discrete  version  of  the 
filter  rather  than  the  continuous  version  (3.40)  was  used.  The  discrete 
version  of  the  extended  Kalman  filter  is  derived  in  Section  V,  and  is: 


48 


re*/ 


where  £  =  is  the  augmented  state  j  xr,  pr)T  (  for  notational  conve¬ 
nience  the  subscript  ”  &  **  is  dropped  the  ?bove  algorithm);  Tp^  is  the  filter 
gain;  Pfc/Ar  t  *s  1116  extrapolated  covariance  matrix;  r*  is  the  gust  effective 
matrix,  and  P^  is  the  covariance  matrix  of  the  estimate  *  The 

Kalman  runs  were  initialized  using  the  param..  .  and  variances  computed 
from  the  equations -of-motion  method  (equations  (3.  3)and  (3.  3d),  respec¬ 
tively).  The  initial  aircraft  state  and  its  covariance  matrix  were  chosen  to 
be  the  state  at  the  first  data  point  and  &  ,  respectively.  The  notation  Fj^ 
for  the  Kalman  runs  in  Table  3.  5  is  to  mean  that  the  initial  used  to  start 
up  the  extended  Kalman  is 

P  - 
o 

where  P£*  is  a  diagonal  matrix  whose  diagonal  elements  are  variances 
computed  using  (3.3d).  The  results  clearly  show  that  the  conjugate  gradient 
method  does  not  give  satisfactory  results.  For  the  case  in  which  process 
noise  is  absent  and  the  measurement  noise  level  is  moderate  (1-C  data),  the 
results  using  quasi) inear ization  and  the  extended  Kalman  filter  are  compa¬ 
rable.  However,  with  the  presence  of  moderate  process  noise  {1-D  data), 
the  parameters  estimated  from  the  extended  Kalman  filter  are  cles  rly 
superior.  Table  3.6  shows  a  comparison  of  the  results  of  the  parameters 
estimated  from  the  quasilinearization  program  and  extended  Kalman  filter 
program  using  a  nonlinear  model  with  acceleration  measurements.  Again, 
the  Kalman  estimates  appear  to  be  better. 

From  the  numerical  experimentation  and  the  analysis  of  the  basic 


I 
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characteristics  associated  with  the  measurement  error  methods,  the  foliow¬ 


ing  remarks  are  in  order: 

1.  if  the  process  noise  or  modeling  errors  are  absent,  then 
the  quasilinearization  method  is  a  sound  identification 
technique;  however,  numerically,  problems  such  as 
convergence  and  nonuniqueness  of  the  solution  do  exist. 

2.  The  conjugate  gradient  method  does  not  appear  suitable 
for  VTOL  aircraft  parameter  identification. 

3.  The  extended  Kalman  filter  is  a  promising  technique 
for  VTOL  parameter  identification. 

4.  Since  process  noise  (gusts,  model  errors,  etc.)  is 
always  present,  the  quasilinearization  method  is  less 
promising  than  the  extended  Kalman  filter. 


3.  3  Methods  Treating  Both  Measurement  and  Process  Noise 

.As  formulated  in  Section  II,  the  problem  of  identifying  V/'STOL  sta¬ 
bility  and  control  parameters  is  basically  a  problem  of  estimating  param¬ 
eters  and  states  in  a  noisy  nonlinear  dynamic  system  utilizing  noisy  nonlinear 
measurements.  This  problem  has  been  the  subject  matter  of  many  papers 
and  reports  m  the  past  few  years.  However,  frequently  motivated  by  the 
desire  to  estimate  the  current  state  and  parameters  for  control  purposes 
(see  for  example.  References  35,  36,  and  37),  the  majority  of  the  effort  has 
been  in  the  area  of  nonlinear  filtering.  Schwartz  and  Stear  (Reference  38) 
lecently  presented  a  computational  comparison  of  six  currently  available 
higher-order  (second-order)  nonlinear  filtering  techniques  with  the  extended 
Kalman  filter,  which  is  a  first-order  nonlinear  filler.  They  concluded  that, 
as  far  as  their  numerical  experimentation  was  concerned,  the  added  com¬ 
plexity  of  the  higher  order  was  not  warranted. 
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However,  as  we  discussed  earlier,  a  fundamental  difficulty  asso¬ 
ciated  with  identification  of  the  V/STOL  aircraft  parameters  is  its  modeling 
problem.  Consequently,  the  identification  technique  must  have  the  capability 
of  detecting  the  modeling  errors.  Filtering  alone  is  not  capable  of  doing  so; 
the  detection  of  the  modeling  errors  can  only  be  done  through  data  smoothing. 
Bryson  and  Frazier  {Reference  4)  were  the  first  to  formulate  the  smoothing 
problem  for  a  continuous  nonlinear  system;  they  formulated  the  problem  as 
a  deterministic  optimal  control  problem  with  a  quadratic  performance  index. 
Although  the  solution  to  the  nonlinear  smoothing  problem  was  obviously 
formidable  and  waa  noi  attempted,  they  were  the  first  to  obtain  the  recursive 
solutions  to  the  linear  case.  Cox  (References  5  and  6)  later  provided  a 
general  formulation  of  the  estimation  of  state  and  parameters  of  nonlinear 
systems  with  Gaussian  process  and  measurement  noise,  and  for  the  linear 
case  he  rederived  the  smoothing  solution  of  Bryson  and  Frazier.  Subse¬ 
quently,  Rauch  (References  39  and  40)  obtained  a  solution  for  the  discrete 
linear  case.  In  his  thesis,  Fraser  (Reference  41)  discussed  extensively  the 
computational  aspects  of  the  linear  smoothing  problems.  Meditch  (Refer¬ 
ence  42)  made  an  attempt  to  solve  a  nonlinear  fixed- interval  problem  by 
directly  solving  the  two-point  boundary  value  problem  using  successive 
approximations.  The  computational  load  is  formidable  even  for  a  second- 
order  problem;  furthermore,  as  new  data  are  received,  a  new  two-point 
boundary  value  problem  has  to  be  solved. 

In  order  to  investigate  in  some  depth  the  feasibility  of  applying  a 
smoothing  technique  to  the  V/STOL  parameter  identification  problem, 

Systems  Control,  Inc. ,  Palo  Alio,  California,  under  subcontract  to  CAL, 
examined  two  smoothing  algorithms  and  concluded  that 

1.  Standard  Smoothing  Algorithm  of  Rauch 

«  requires  large  storage  for  filtered  state  and 
covariance  matrices  and  hence  is  difficult  to 
implement. 
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l.  A  Simplified  Smoothing  Algol  ithm 

•  requires  the  use  of  only  the  data  but 

•  it  has  computation  difficulty. 

An  alternate  simplified  "smoothing"  algorithm  using  backward  filtering  was 
proposed.  Although  this  method  is  not  capable  of  estimating  the  unknown 
forcing  functions,  the  parameter  estimates  may  be  significantly  improved  by 
"appropriately"  increasing  the  covariance  from  the  results  of  the  first  for- 
•.vard  filter  run  to  start  up  the  backward  filter.  However,  in  all  of  the  above 
work,  the  primary  concern  has  been  with  the  fixed-interval  rather  than  the 
fixed-point  smoothing  problem.  Fixed-point  smoothing  is  the  important 
problem  associated  with  parameter  identification,  as  will  be  discussed  in 
Section  5.  1.3. 

The  problem  of  fixed-point  smoothing  for  a  linear  system  was  first 
derived  by  Rauch  {Reference  39)  for  discrete  systems  and  later  by  Meditch 
{References  43  and  44)  for  continuous  systems.  Unfortunately,  very  little 
work  has  been  done  toward  solving  the  fixed-point  smoothing  problem  for 
nonlinear  systems,  a  problem  of  considerable  importance  in  parameter 
identification.  In  a  recent  paper,  Kagiwada  {Reference  45)  employed 
invariant  imbedding  to  obtain  a  sequential  approximate  solution  for  the  fixed- 
point  smoothing  problem  for  continuous  nonlinear  systems  with  continuous 
nonlinear  measurements.  Because  of  the  deterministic  approach  of  using 
the  least  square  cost  functional,  the  quality  of  the  obtained  estimates  is 
usually  hard  to  interpret.  Furthermore,  it  is  interesting  to  note  that  the 
filtering  pass  is  identical  to  the  Detchmendy-Sridhar  filter  (Reference  27). 
The  Detchmendy-Sridhar  filter  is  only  first  order  in  the  system  dynamics 
nonlinearity,  and  therefore  the  bias  of  the  estimates  may  be  significant 
’■•hen  system  nonlinearity  is  severe.  Thus,  the  development  of  a  new  tech¬ 
nique  which  does  no,  have  this  limitation  for  V/STOL  parameter  identifica¬ 
tion  is  required. 


The  development  cf  a  new  technique  is  described  in  detail  in 
Section  V.  In  developing  the  technique,  a  continuous  nonlinear  system  driven 


by  white  Gaussian  noise  with  noisy  discrete  nonlinear  measurements  was 
considered  to  characterize  the  model  -  as  formulated  in  Section  II. 


Data  Point 

Estimated  Trajectory 


(f)X  ‘osuodsoH 
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Figure  3-1  Quasiiinearization  Solution  for  the  Minimum 


TABLE  3-1  -  Effects  of  Process  and  Measurement  Noise  on  Parameter 

Estimates  Using  the  " Ecjuations-of-Motion"  Method 
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This  column  refers  to  noise  free  data 


TABLE  3-2  -  Effects  of  Process  and  Measurement  Noise  on  Parameter 

Estimates  Using  Modified  Soline  Function  Method 
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TABLE  3-3b  -  Effects  of  Process  and  Measurement  Noise  on  Parameter 
Estimates  Using  Polynomial  Estimator  -  Ninth  Degree 


TABLE  3-6 


Comparison  of  Methods  Using  Nonlinear  Model 


|\ 

\ 

Actual 

Value 

2-C-. f 

Mode.-2.te  Measurement  Noise 

2-D-l  ♦ 

Moderate  Measurement  Noise 

E2T3&K1 

■KAQ2JK 
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earvzauon 

Kal m»«i  # 

of 

Woi»»A 

Quaailin-* 

earization 

£alm<kn##  j 
_5-  i 

(' 

.50518 

-1.281 

- 1. 2*96 
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.  4758 
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-.00308 

.02197 

.02116 

-.0064 
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-9. 3xl0‘5 

.5 

-9.  5 3.x  10 
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-.0001136 

-.0001136 

-4.  3x10"  5 
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9MQ 

.02061 

.01953 

.01094 

.01094 
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I 

1 

-.000228 

-.000216 
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-.497 

-2.850 

-2.6792 

-.  1 61) 

-1.2881 

•  1.2881 

-.8519 

-.00103 

.01777 

.01649 

.  00065 

.007815 

.007815 

.00315 

M 

i 

.37613 

.46712 

.  336 

-  7305 

-.7305 

-.581 
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m 

I 

. 0006687 

.0001056 

.0011 

.009188 

.009188 

.0080 
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18.  30 

-15.884 

-128.84 

13.93 

-19.148 

-19. 1477 

-5.671 

XU 

-.09167 

.4332 

1.587 

-.0297 

.4802 

.4802 

.2408 

-.0003 

-.00232 

-.00468 

-.  000523 

-.002485 

-.002485 

-.00149 

.2211 

.6174 

m 

-.257 

.6933 

.6933 

.4469 

mj 

-.001587 

-.00464 

SB 

-.00189 

-.005292 

-.00318 

See  Table  D-Z,  Appendix  D  for  explanation  and  definition  of  noise  levels. 
c-C-1  and  2-D-l  data  were  generated  using  the  control  perturbation  shown  below 
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In  these  quasilinearization  runs,  the  term  ah  / in  (3.  19)  was  neglected. 

Fl  •  F10  '  Denote  the  Kalman  £ilter  runs  for  which  the  initial  covariance 
matrix  P0  for  the  parameters  is  equal  to  variance  of  the 
parameters  estimated  from  the  E.O.M.  estimator  multiplied 
by  1  and  10  respectively. 


SECT  ION  IV 


PARAMETER  IDENTIFIABILITY 

The  identifiability  of  parameters  is  concerned  with  the  ability  to  solve 
for  all  the  unknown  parameters  from  the  given  data.  It  is  intuitively  obvious 
that  those  parameters  which  have  no  effects  on  the  data  cannot  be  identified. 
Consider  a  hovering  X-22A  aircraft  in  calm  air,  for  example.  Then,  for 
application  of  a  collective  input  h&c  .  all  the  stability  and  control  parameters 
with  the  exception  of  the  vertical  damping  and  the  vertical  control  effec¬ 
tiveness  will  not  affect  the  data.  Since  in  this  situation  only  2^  and  2V 

affect  the  data,  it  is  intuitively  clear  that  no  parameters  other  than  these  two 
can  be  identified. 

Perhaps  it  was  Lee  (Reference  46}  who  first  discussed  the  identifi¬ 
ability  of  a  system.  He  examined  the  identifiability  of  a  single  output  linear 
autonomous  discrete  system  and  found  that  the  system  was  identifiable  if  and 
only  if  the  initial  state  vector  (initial  conditions  of  the  system)  excited  all  the 
natural  modes  of  the  system.  Subsequently,  Fisher  (Reference  47)  studied  the 
identifiability  ^f  a  continuous  single  input  linear  time -invariant  system  and  con¬ 
cluded  that  the  system  was  identifiable  if  and  only  if  the  system  was  com¬ 
pletely  controllable  and  the  control  function  was  not  linearly  related  to  the  state 
variables. 

It  was  not  until  recently  that  the  problem  of  identifiability  of  nonlinear 
systems  was  touched  upon.  In  identifying  the  orbit  parameters  from  lunatr 
orbiter  tracking,  Pfeiffer  (Reference  48)  loosely  defined  unobservable,  weakly 
observable,  and  strongly  observable  parameters.  He  defined  the  observability 
of  these  parameters  in  terms  of  the  diagonal  elements  of  an  orthogonal  trans¬ 
formation  of  the  matrix  in  the  normal  equation  resulting  from  a  linearization 
of  orbit  equations  about  the  nominal  trajectory.  Experience  in  linear  systems 
has  indicated  that  identifiability  is  a  property  different  from  observability; 
the  former  depends  on  bnh  system  and  input,  the  latter,  however,  depends  on 
the  system  only.  Because  of  this,  a  clear  cut  condition  for  the  identifiability 
of  nonlinear  systems  has  been  lacking. 
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Closely  related  to  the  identifiability  problem  Is  the  problem  of  the 
uniqueness  of  the  solutions.  There  appear  to  be  two  differ 'nt  uniqueness  proD- 
lems*.  one  stems  from  thi  system  configuration,  and  the  other  from  the  data 
(inputs  and  outputs)  given.  The  latter  problem  was  discussed  in  Section  3.2. 
Comparatively  speaking,  it  has  received  less  treatment  than  that  stemming 
from  the  system  configuration.  Lavi  &  Strauss  (Reference  49)  were  perhaps 
the  first  to  mention  this  problem;  unfortunately,  without  offering  their  own 
study,  they  only  suggested  that  this  problem  should  be  investigated. 

In  the  early  stages  of  our  study  of  the  identification  of  VTOL  aircraft 
parameters,  it  was  found  that  identification  techniques  such  as  quasilineari¬ 
zation  did  not  give  unique  solutions  -  the  solutions  depended  upon  the  initial 
estimates.  This  prompted  an  investigation  into  the  problem  of  identifiability 
and  uniqueness  of  the  solutions.  Some  results  of  this  investigation  are  pre¬ 
sented  here. 

4,  1  Identifiability  for  Noiseless  Measurements  -  Linear  Stationary 

Systems 

To  begin  with,  it  seems  instructive  to  analyze  the  simplest  case, 
namely  the  case  in  which  the  system  is  linear  and  the  data  (output)  are  noise¬ 
less.  Consider  the  following  problem: 

Given  -  A  multi-input,  multi-output  linear  time -invariant  system 

System  |  i(t)  =  F.  »(t)  *  G>u(t)  (4.1a) 

l 

(  Lj(t)  -  AW  (4.  lb) 

where  %  is  the  state,  n-vector 

il  is  the  control  vector,  r-vector 
Lj  is  the  output,  m-vector 
and  the  data  u(t)  and  y(i)  are  given  for 


Find;  the  tripie 


(a)  Uniqueness  problem  and  the  maximum  number  of 
independent  parameters  - 

Tt  is  readily  seen  that  there  is  no  unique  solution  for  the  triple 
(  f-~;  d  ,  ■'  }.  Indeed,  there  are  infinite  sets  of  (  F ,  ,  H  )  that  are  satisfied 

by  the  equations  (4.  la)  and  {4  lb)  with  the  data  given.  To  see  this,  iet  us 
consider  a  nonsingular  linear  transformation  M  such  that 


then 


(4.2) 


MFM~ 1  %  +M6u 


(4.  3a) 


(j  =  (4.3b) 

Note  that,  as  far  as  input-output  relationships  are  concerned,  systems 
(4.  1)  and  (4.3)  are  completely  equivalent;  therefore,  the  solution  for 
(  F  ,  6  ,  //  )  is  not  unique.  It  is  to  be  noted  also  that  in  equations  (4.  1),  there 
is  a  total  of  m (rt tm-tr)  parameters.  However,  these  parameters  are  not 
independent  insofar  as  the  input-output  relationships  are  concerned.  In  fact, 
it  can  be  shown  that  there  is  a  maximum  of  only  nfa-rr)  independent  param¬ 
eters  (Reference  12). 


As  a  result  of  the  points  discussed  above,  it  can  then  be  shown  that 
only  the  transfer  function  matrix  relating  the  outputs  to  the  inputs  can  be 
identified.  The  transfer  function  matrix  for  the  system  (4.  1)  is  unique,  and 
is  independent  of  the  coordinate  systems  (4.  2).  Indeed,  from  (4.  3) 

cj(s)  =  jsZ-AfFAT'jMauts) 

=  hW1  [sM-'-^AT7]  'fau&  (4.4) 

-  /■/  [s I-fY&uCs) 
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which  is  the  transfer  function  matrix  for  (4.  1). 


ib)  Identifiability  conditions  and  the  solution  - 


In  order  to  avoid  the  nonuniqueness  problem  for  the  triple  (  F  , 
Q  ,  F  ),  consider  the  special,  but  important,  case  in  which  all  of  the  state 
variables  are  measurable,  i.e.,  ^  1  .  Then: 


System  I  jo  =  F'z(t)  +  Gu(t) 
5-2  < 

[  y(t)  •  v(t) 

From  (4.  5a) 

1o(t)~  %(o)  =  F 


t  z 

J  *(VdT+  G  J  a(Z)o’Z 


(4.  5a) 
(4.  5b) 


%(t)  =  Z(t)~X>(o)  -  n -vector  function 

sy(b)  =  J  %(f)c/Z  -  n-vector  function 

v(t)  •=  J  u(t)d'C  -  r-  ector  function 


Then 


Define 


*(*)  •(?!&) 


Z(£) 

t  V[tj. j 


A  «/  %(t)  {f(t)\\fT(t)]* 


B 

’  2d)  ~ 

W(i)  i 

u 

o  ! 

.  v(e) . 

L  • 

Note 

that 

A  is 

v  x  r)  constant  matrix 

3  is 

(r>  +  r)  k 

(mr) 

i  constant  mat 

If  3 

has  full 

rank  (i 

•  6  •  ) 

nonsinguiar),  1 

(4.6) 


(4.7a) 


(4.7b) 
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[p ;  s] 8 


or 


M  * 


AB 


.1 


(4.8a) 


(4.  8b) 


Thus,  system  (  5-2  )  is  identifiable  if  and  only  if  3  is  nonsingular.  It  is 
clear  from  (4.  7b)  that  B  is  nonsingular  if  and  only  if  [  are  linea~,,>- 

independent.  Physically,  this  means  that  all  the  natural  modes  of  the  s /  . 

(  5*2  )  are  excited  and  the  control  functions  are  linearly  independent  of  the 
state  variables  and  also  independent  of  themselves.  Fisher  has  investigated 
the  case  in  which  V(t)  is  a  scalar  function  (i.  e.,  a  single  input  case)  and 
concluded  that  the  system  (  S-2  )  with  single  input  is  identifiable  if  and  only  if 
the  system  is  controllable  and  the  control  function  is  linearly  independent  of 
the  stable  variables.  In  the  multi-input  case,  this  set  of  conditions  is  not 
sufficient,  because  the  controllability  of  the  pair  (  F  ,  G  )  does  not  imply 
pairwise  controllability  (i.  e. ,  (F  ,  qi  },  (  p  ,  q  ),...,( F,  qr  )  are 
controllable  where  Ct  =  (tff,  )  )•  Thus,  we  conclude  that: 


(i)  System  { S-2)  is  identifiable  if  and  only  if  all  the  natural  modes 
of  the  system  are  excited  and  the  control  functions  are 
linearly  independent  of  the  state  variables. 

(ii)  A  sufficient  condition  for  the  system  S-2  to  be  identifiable 

is  that  (F  ,  Q;  ")  ,  i  -  1,2,. ..y  f  are  pairwise  controllable 

and  the  control  functions  u(t)  are  linearly  independent  of 
the  state  variables,  and  are  also  independent  of  themselves. 


It  should  be  pointed  out  that  the  above  conditions  for  identifiability  are 
restricted  to  linear  time-invariant  systems.  It  is  conceivable  that  this 
approach  cannot  readily  be  extended  to  nonlinear  systems,  which  are  of 
major  importance  to  the  VTOL  parameter  identification  problem.  In  the 
following  section  we  will  take  a  different  approach  which  utilizes  the  concept 
of  the  sensitivity  vector  functions. 
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Sensitivity  Vector  Functions 


Linear  System  -  Deterministic  Case 


In  this  section  we  shall  discuss  the  importance  of  the  sensitivity  vec¬ 
tor  functions.  Unlike  quantities  such  as  natural  modes,  which  are  of  use 
solely  in  linear  systems,  a  set  of  the  sensitivity  vector  functions  is  a  unique 
entity  in  both  linear  and  nonlinear  systems.  Let  us  consider  first  the  system 
5-2  .  Differentiating  (4.  5a)  with  re  pect  to  a  representative-  parameter  (orfj) 


gives 


_d_  9% 
~dt 


9a  9F 

*3%  X  (t> 


(4.9a) 


d  9v.  _  ^  9x  9G  '  s 

dt  9Pj  ~  F  SP:  T  Wj 


(4.  9b) 


(O)  =  0  ,  i  -  /,  2,  ... 


(0)  =0  ,j  =  /,  2, 


(4.  9c) 


where  p  and  are  the  total  number  of  parameters  in  F  and  £  respectively. 
To  see  clearly  the  sensitivity  vector  functions  in  (4.9c)  consider  a  third- 
order  system  with  all  nine  unknown  elements  in  P  and  sir.  unknowns  in  . 


We  have  then 


d 

9* 

~dt 

a 

d% 

dt 

% 

d 

By* 

~dt 

| 

V*  I 

d 

3'0 

dt 

d 

Pv. 

dt 

P-Pt) 

if) 

\  0  1 

\  o  I  I  *iW\ 

1  >  (i )\  uhere  To (i)  =  %z(t) 

I  n  i  v3(t)  j 


\  0 


/  w  ! 
i 


(4.  10a) 
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d 

Hi 

tyo 

d 

dv 

~dt 

d 

9p 

'It 

d 

dp 

dt 

u,(t) 

0 

0 


a* 

- - 4  0 

*?,t  \  0 


ivhcrr. 


-  F  - *  0 

S-Pt+  l  l i,  60/ 

9%  I  0  \ 

"  S-P,i  '  (  U,(i)l 

u.!t)  &  (  M  j 


r  (°i  *  °> irl  t>2>—>f5' 


(4.  10b) 


The  solution  to  the  first  equation  in  (4.  10a)  for  example,  is  well  known  and  is 
given  by  t 


Since  the  transition  matrix  e **  is  nonsingular,  i.  e. ,  all  its  columns  (and 
hence  its  rows)  are  linearly  independent,  and  since  the  integration  (4.  11)  is 
a  linear  operation,  it  is  readily  seen  from  (4.  10)  that 

(i)  If  x,  (t)  ,  Pz  (i)  and  V3  (t)  are  linearly  independent  and 
the  control  functions  it,  (i)  and  uz  (*)  are  linearly 
independent  and  are  also  linearly  independent  of  *,(*)>  Xz  (*) 
and  (t)  ,  then  all  the  sensitivity  vector  functions  are 
linearly  independent. 
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(ii)  The  sensitivity  functions  are  linearly  dependent  if  the  state 
variables  are  linearly  dependent  or  the  control  functions 
are  linearly  dependent  among  themselves  or  are  linearly 
dependent  upon  the  state  variables. 

It  is  not  difficult  to  see  that  these  statements  hold  for  a  general  case  other 
than  a  third-order  system. 

The  above  conclusions  can  be  combined  to  become: 


Theorem  1 


The  sensitivity  vector  functions  are  nontrivial  and  are  linearly 
independent  if  the  state  variables  are  linearly  independent  and  the  control 
functions  are  linearly  independent  and  also  linearly  independent  of  the  state 
variables. 


Using  spectral  decomposition  (References  50  and  51)  and  using  the  well 
known  fact  that  a  modal  matrix  (matrix  consisting  of  all  the  eigenvectors) of  F 
is  nonsingular,  it  can  readily  be  shewn  that  the  state  variables  are  linearly 
independent  i'  and  only  if  ail  the  natural  modes  of  the  system  are  excited. 


Using  this  fact  we  establish  the  following  important  result: 


Theorem  l 

The  sensitivity  vector  functions  are  nontrivial  and  are  linearly 
independent  if  and  only  if  all  the  natural  modes  of  the  system  are  excited  and 
the  control  functions  are  linearly  independent  among  themselves  and  are  also 
linearly  independ*-  •  of  the  state  variables. 

The  abov\  .orem  clearly  indicates  that  the  linear  independency  of 
the  sensitivity  vector  functions  is  equivalent  to  the  identifiability  conditions. 

Thus,  we  have  established  the  ‘‘allowing  theorem: 
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Theorem  3 


System  (  S-2 )  is  identifiable  if  and  only  if  all  the  sensitivity  vector 
functions  are  nontrivial  and  are  linearly  independent. 

From  Theorem  3  it  becomes  apparent  that  an  approach  that  uses 
sensitivity  vector  functions  in  lieu  of  equation  (4.8)  is  possible.  Denery 
(Reference  12)  recently  proposed  a  method  for  obtaining  an  initial  parameter 
estimate  using  sensitivity  vector  functions  and  a  state  observer  concept 
(Reference  52), as  we  discussed  in  3.  1. 


At  this  point,  it  is  important  to  point  out  once  again  that  the  triple 

{  F  ,  G  ,  hi  )  in  the  system  5-1  is,  in  general,  not  identifiable.  However, 

if  hi  is  known  and  is  square  and  nonsingular,  then  the  above  results  stiil  hold. 

If,  on  the  other  hand,  H  is  not  a  square  matrix,  then  the  output  sensitivity 

vectors  9% 

—  =  H - 

3ft  dfi 

are  no  longer  linearly  independent  even  if  are.  In  other  words,  the 

output  sensitivity  vector  functions  are  not  linearly  independent  if  the  number 
of  the  unknown  parameters  in  F  and  G  is  more  than  m  (m  +  r) .  This  is 
illustrated  in  the  following  simple  examples. 

Example  1.  Let  the  true  values  of  the  following  single  input  -  single 
output  linear  system 

Y-  -  Az  +  biA 

•i  - 


It  is  readily  seen  that  the  system  is  controllable  and  observable.  Note  that 
the  system  can  have  only  a  maximum  number  of  four  (  2x  (1+1)  )  independent 
parameters. 
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Let  h  be  known  and  the  nonzero  parameters  in  A  and  b  be  unknowns. 
Note  that  there  at  '  four  parameters  and  hence  the  condition  for  maximum 
number  of  independent  parameters  is  met.  A  perturbation  of  those  parameters 
from  thsir  true  values  yields  the  following  (state)  sensitivity  vector  equations 
with  zero  initial  conditions: 
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Let  the  control  function  u(t)  be  a  unit  step  function  for  the  sake  of  algebraic 
simplicity.  A  straightforward  computation  shows  that 
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It  is  clear  that  these  (state)  sensitivity  vector  functions  are  linearly  indepen¬ 
dent.  The  output  sensitivity  functions  are  also  linearly  independent.  They 
<t  re 
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Example  2.  Now  we  consider  the  case  when  the  true  values  of  4  and  b 


Note  that  the  system  is  still  controllable  and  observable.  However,  there 
are  now  five  unknowns.  A  perturbation  from  these  true  values  and  again 
using  a  unit  step  function  for  the  control  function  u,  (t)  yields  the  following 
(state)  sensitivity  vector  functions: 
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'1  he  state  sensitivity  vector  functions  are  clearly  still  linearly  independent. 
However,  the  output  sensitivity  functions  are  no  longer  linearly  independent. 
They  are 
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From  these  examples,  it  is  evident  that  for  the  deterministic  case, 
identifiability  implies  uniqueness.  Thus,  nonuniqueness  due  to  die  system 
configuration  is  of  no  major  problem  in  parameter  identification.  The  major 
problem  of  uniqueness  is  due  to  data  as  was  briefly  discussed  in  Section  3.  Z. 

Linear  and  Nonlinear  Systems  with  Noisy  Measurements 

In  the  above  discussion,  we  have  restricted  ourselves  to  the  noiseless 
linear  systems.  It  was  shown  that  if  a  system  is  identifiable,  the  solution 
can  readily  be  obtained  without  iteration  and  without  initial  guess  values  for 
the  parameters.  For  noisy  measurements,  the  regressor  in  the  normal 
equation  (4.8a)  becomes  stochastic,  and  the  initial  estimates  using  (4.  8b)are 
asymptotically  biased.  The  bias  can  be  removed  using  iterative  techniques 
such  as  the  method  of  quasilinearization  as  discussed  in  Section  3.  2.  We  now 
continue  our  discussions  on  the  importance  of  the  sensitivity  vector  functions 
in  conjunction  with  the  use  of  these  methods.  In  order  to  be  consistent  with 
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equation  (4.8a),  we  shall  first  consider  the  quasilinearization  method. 

Consider  the  following  problem; 

i  =  -f  (%>-p3'm) ,  v(o)  =  ot  (4.12a) 

q  -  TP  *  v  (4.  12b) 

where 

-  state  vector 
<4  =  output  vector 

V  -  error  vector  of  the  measurement 
w  =  control  vector 

f  =  vector  function  of  appropriate  dimension 


As  shown  in  Section  3.  2,  Lhc  quasilinearization  algorithm  for  the  parameter 
estimation  which  minimizes  the  performance  index 

J=  {  J  (rtfw(r%)dt  (4.  12c) 

0 

where  t,  denotes  the  final  time  and  W  is  a  positive  definite  symmetrical 
matrix,  is  as  follows  ; 
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It  is  clear  iron  (4.  13)  that  the  sensitivity  vector  functions  ^fdf  in  the  sen¬ 
sitivity  matrix  must  be  linearly  independent  in  order  to  have  the  matrix 
inversion  n  (4.  13)  exist.  In  other  words,  the  nonlinear  system  (4.  12)  is 
identifiable  by  the  method  of  quasilir.ea  rization  if  and  only  if  the  sensitivity 
vector  functions  J'i9fL  are  linearly  independent.  From  the  connection  estab¬ 
lished  in  Reference  19  between  the  method  of  quasilinearization  and  extended 
Kalman  filtering,  it  can  be  shown  that  the  above  statement  is  also  true  for  the 
method  of  extended  Kalman  filtering. 

In  general,  the  output  in  equation  (4.  12b)  is  to  be  replaced  by 

tj=  q('i) 

and  the  linearity  of  the  output  sensitivity  vector  functions 

dij  _  /  9g  \  3% 

Hpi  "te/  5^ 

becomes  essential  for  the  identification  of  the  unknown  parameters  in  (4.  12a). 
4.  3  Problem  of  Uniqueness  Due  to  Data 

On  the  basis  of  the  previous  discussion,  it  can  be  shown  that,  for  the 
deterministic  case,  the  solution  for  the  parameters  is  unique  if  the  system  is 
identifiable.  For  a  noniterative  scheme  (such  as  the  scheme  defined  in  equa¬ 
tion  (4.8b)  ),  it  is  clear  that  the  solution  is  unique  regardless  of  whether  the 
system  is  linear  or  not  (as  long  as  parameters  enter  in  the  equations  linearly). 
Furthermore,  the  parameters  identified  are  the  true  values.  Table  4-1  lists 
the  resuits  of  two  numerical  experiments  for  both  a  linear  and  nonlinear  rep¬ 
resentation  of  a  VTOL  aircraft.  For  an  iterative  scheme  such  as  equation 
(4.  13),  the  identifiability  also  implies  uniqueness  (within  a  reasonable  bound 
resulting  from  the  convergence  criterion  used  in  the  iteration).  The  fact  that 
the  residue  vector  y-  &(p)  in  equation  (4.  13)  can  be  identically  zero  permits 
the  condition  that  =0  be  automatically  satisfied.  :  e.  ,  the  residue  vector 
tj  -  iff)  is  orthogonal  to  the  subspace  spanned  by  the  sensitivity  vector 
functions  --  in  the  language  ol  Hilbert  space  (Reference  50)-  However,  due 
to  the  convergence  criteria  us~d  in  the  iterative  scheme,  uniqueness,  in  the 
sense  of  the  numerical  values  identi/.ed,  is  not  computationally  possible  if 
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the  initial  estimates  are  not  the  same  (and  the  computer  time  is  limited). 

This  statement  has  also  been  confirmed  by  some  numerical  experiments. 

If,  on  the  other  hand,  errors  exist  in  the  measurements,  then  identi- 
fiability  does  not  imply  uniqueness  regardless  of  whether  or  not  the  system 
is  linear.  In  this  situation,  a  noniterative  scheme  such  as  equation  (4.  8b) 
v/ill  give  a  biased  parameter  estimate  (see  Appendix  B).  Therefore,  although 
the  solution  is  unique  for  the  given  data,  it  becomes  useful  only  to  provide  an 
initial  estimate  for  the  iterative  methods.  For  iterative  methods,  the  non¬ 
uniqueness  problem  has  already  been  discussed  (Section  3.2).  We  shall  not 
repeat  it  here. 

4.4  Concluding  Remarks 

In  conclusion,  the  following  remarks  on  the  identifiability  and  unique¬ 
ness  problems  associated  with  parameter  identification  of  linear  and  non¬ 
linear  3vstems  are  evident. 

(i)  A  system,  linear  or  nonlinear,  is  identifiable  if  and  only 
if  the  sensitivity  vector  functions  are  nontrivial  and  are 
linearly  independent. 

(ii)  The  sensitivity  vector  functions  are  nontrivial  and  are 
linearly  independent  if  and  only  if  the  state  variables 
are  linearly  independent  and  the  control  functions  are 
linearly  independent  and  are  also  linearly  independent 
of  the  state  variables. 

(iii)  For  the  deterministic  case,  the  solution  for  the  param¬ 
eters  is  unique  if  the  system  is  identifiable. 

(iv)  If  errors  exist  in  the  measurements,  then  the  identifiability 
does  not  imply  uniqueness,  regardless  of  whether  the 
system  is  linear  or  not. 
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Since  the  sensitivity  vector  functions  depend  not  only  on  the  system  but  also 
on  the  input,  it  is  extremely  desirable  to  design  an  input  to  increase  the 
sensitivity  and  hence  the  parameter  identifiability.  Problems  concerning  the 
design  of  an  appropriate  input  are  discussed  in  Appendix  F . 
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TABLE  4-1 


Parameter  Identification  for  Noiseless  Data 
Using  a  "Least-Squares”  Method 
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bEL  ilON  V 


DEVELOPMENT  OF  ADVANCED  IDENTIE  ICATION  TECHNIQUES 

The  parameter  identification  of  VTOL  aircraft  as  formulated  in  Sec¬ 
tion  II  is  fundamentally  a  problem  of  nonlinear  estimation.  By  annexing  the 
constant  parameter  vector  to  the  state  vector,  it  becomes  apparent  that 
parameter  identification  is  a  problem  of  state  estimation  of  a  nonlinear  sys¬ 
tem  even  if  the  original  equations  of  motion  are  linear.  vVe  note  also  that 
if  accelerations  or  ot  -vane  seniors  are  used  as  measurements,  the  mea¬ 
surement  system  is  also  nonlinear. 

For  the  reasons  discussed  in  Section  III,  the  equations -of-motion 
method  (a  least-square  method)  is  chosen  as  the  initial  estimator  for  the 
extended  Kalman  filter,  which  appears  to  be  a  very  promising  inethod  for 
parameter  identification  for  VTOL  aircraft.  However,  as  is  shown  in 
Appendix  H,  the  extended  Kalman  filter  is  a  biased  estimator  in  the  presence 
of  nonlinearities,  and  nonlinearities  are  inherent  in  parameter  identification 
problems.  Since  the  extended  Kalman  filter  algorithm  is  derived  on  the 
assumption  that  the  estimate  is  unbiased,  (as  is  true  in  the  linear  case),  the 
quality  of  the  estimate  is  overestimated.  The  extended  Kalman  filter  may 
be  regarded  as  incorporating  a  gain  which  changes  the  estimate  of  a  param¬ 
eter  based  on  the  quality  of  its  previous  estimate.  Recalling  that  the  Kalman 
filter  is  a  sequential  estimator,  it  can  be  seen  that  an  overly  optimistic 
estimate  of  the  parameter  quality  forces  .ie  filter  gain  to  decrease  and  there¬ 
fore  the  filter  relies  less  on  subsequent  data. 

As  is  shown  in  Appendix  H,  if  initial  estimates  are  unbiased,  the  bias 
of  the  extended  Kalman  filter  estimates  depends  on  the  multiplicative  effects 
of  the  system  and  measurement  nonlinearities  and  the  covariance  of  the  esti¬ 
mate.  As  the  entire  data  are  processed  by  the  extended  Kalman  filter,  the 
variances  of  the  final  parameter  estimates  reduce  from  those  of  the  initial 
estimates.  One  may  thus  be  tempted  to  reuse  the  data  all  over  to  reduce  the 
bias  of  the  estimates.  Two  schemes  of  reusing  the  data  have  previously  been 
tried  and  axe  shown  in  Figure  5-1.  Both  methods  regard  the  first  extended 
Kalman  filter  as  the  second  initial  estimator  (the  equations -of-motion  method 
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being  the  first  initial  estimator).  However,  the  second  extended  Kalman  in 
the  first  scheme  uses  the  data  in  a  forward  manner;  whereas  the  second 
filter  in  the  second  method  uses  the  data  in  a  backward  fashion.  It  is  apparent 
from  the  above  discussion  on  the  basic  ..naracteristics  of  the  extended  Kalman 
filter  that  the  second  scheme  has  the  virtue  of  being  able  to  appropriately  use 
the  last  part  of  the  data,  if  the  variance  of  the  parameter  estimates  at  the 
end  of  the  forward  pass  is  "suitably"  increased  in  some  artificial  way. 

However,  a  fundamental  difficulty  common  to  both  schemes  of  reusing  the 
data  is  the  determination  of  how  co  adjust  the  variance  of  the  parameter  esti¬ 
mates  from  the  first  filter  to  start  up  the  second  filter. 

Another  major  difficulty  associated  with  identification  of  the  VTOL 
aircraft  parameters  is  the  relative  uncertainty  in  formulating  the  equations 
of  motion  due  to  the  complex  interaction  of  propulsive  and  aerodynamic  forces 
and  moments.  Consequently,  the  identification  technique  must  have  the 
capability  of  detecting  the  modeling  errors  to  facilitate  an  improvement  of 
the  model.  As  was  discussed  in  Section  III,  the  detection  of  modeling  errors 
requires  the  estimation  of  the  unknown  forcing  functions,  which  can  be  ob¬ 
tained  only  through  data  smoothing.  Initially,  we  (and  SCJ's  subcontract 
work)  directed  our  efforts  toward  examining  more  or  less  exclusively 
the  feasibility  of  applying  fixed  interval  smoothing  techniques  to  VTOL  param¬ 
eter  identification.  However,  the  fixed  interval  smoothing  algorithms  cur¬ 
rently  available  either  require  an  extremely  large  amount  of  storage  for  the 
filtered  state  and  error  covariance  matrices  or  have  computational  difficulties. 

Thus,  our  major  efforts  in  the  development  of  techniques  for  VTCL 
parameter  identification  have  been  to  overcome  arui/or  to  alleviate  the 
aforementioned  difficulties.  Specifically,  the  following  tasks  have  been  per¬ 
formed: 

(1)  Development  of  a  locally  iterated  filter -smoother  (multi¬ 
corrector)  for  better  parameter  estimation. 
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(2)  Development  of  a  fixed-point  smoothing  technique  to 
facilitate  the  computation  of  the  unknown  forcing 
functions  to  aid  in  detecting  mode'mg  errors. 

(3)  Improvement  of  the  variance  computation  to  better  predict 
the  quality  of  the  parameter  estimates. 

This  section  is  organised  as  follows:  Section  5.  1  describes  in  detail 
the  developed  techniques;  Section  5.2  presents  the  derivation  of  the  locally 
iterated  filter- smoother  and  the  fixed-point  smoothing  algorithm;  the  com¬ 
putational  algorithm  for  the  unknown  forcing  functions  is  discussed  in  Sec¬ 
tion  5.3;  and  Section  5,4  discusses  the  improved  covariance  matrix  com¬ 
putations.  The  results  of  numerical  experiments  are  shown  in  Section  VI. 


5.  1  Description  of  the  Developed  Techniques 

After  the  extended  Kalman  filter  computer  program  had  been  developed 
and  selected  as  the  major  tool  for  VTOL  aircraft  parameter  identification, 
subsequent  efforts  were  directed  toward  improving  the  accuracy  of  the  param¬ 
eter  estimates  by  developing  a  multi-corrector  Kalman  filter  technique, 
developing  a  fixed-point  smoothing  technique  to  facilitate  the  computation  of 
unknown  forcing  functions  to  detect  modeling  errors,  and  obtaining  a  better 
prediction  of  the  quality  of  the  estimate  parameters.  Figure  5-2  shows  a 
schematic  diagram  of  CAL’s  developed  identification  program.  Details  of 
each  block  in  the  figure  are  described  in  the  following  subsections. 

5.1.  1  Initial  Estimator  Program 

As  discussed  in  Section  III,  the  initial  estimator  program  is  essen¬ 
tially  a  computer  program  using  the  equations~of-motion  method.  Using  the 
measured  data  of  inputs  and  outputs,  this  program  produces  a  set  of  param¬ 
eter  estimates  and  a  set  of  approximate  variances  of  the  estimates.  When 
measurements  are  corrupted  with  noise,  as  is  always  the  case  in  a  practical 
situation,  this  method  of  parameter  estimation  produces  biased  estimates. 
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As  the  measurement  noise  to  signal  ratio  increases,  the  bias  increases.  As 
a  result  of  the  bias,  the  variance  computed  from  this  initial  estimator  program 
(3.3d)  poorly  represents  the  true  quality  of  the  estimation  error.  Depending 
on  the  level  of  the  measurement  noise,  or  more  precisely  the  noise-to-signal 
ratio,  the  computed  variance  can  be  grossly  optimistic,  i.  e. ,  the  computed 
variance  is  too  small  in  comparison  with  the  square  of  the  actual  estimation 
error.  As  a  result,  variances  from  the  initial  estimator  are  too  small  to 
properly  "start  up*  the  multi-corrector  filter  program.  Therefore,  in  all 
previous  identification  runs,  either  generated  data  or  flight  test  data,  it  was 
necessary  to  use  engineering  judgment  to  adjust  the  initial  covariance  matrix 

P(o)  . 


Experience  has  shown  that  an  increase  in  the  computed  covariance 
from  the  initial  estimator  program  by  a  factor  of  ten  produced  the  best  re¬ 
sults.  However,  the  best  factor  to  use  in  each  particular  situation  is  not 
known,  since  it  is  strongly  dependent  upon  the  control  input  and  noise  levels 
present.  Thus,  a  more  automatic  and  preferable  way  to  start  up  the  multi- 
corrected  filter  is  to  calculate  P(o)  by  a  different  scheme.  Discussions  of 
this  and  related  problems  will  be  given  later.  In  the  following,  we  shall 
first  describe  the  multi-ccrrected  extended  Kalman  filter,  the  fixed-point 
smoother,  and  the  computation  of  the  unknown  forcing  functions. 

5.  1.  2  Multi-Corrected  Extended  Kalman  Filter 

Previously  we  discussed  the  fact  that  the  extended  Kalman  filter  is  a 
biased  estimator  in  the  presence  of  nonlinearities,  which  are  inherent  in 
parameter  identification  problems.  One  way  to  correct  for  system  and  mea¬ 
surement  nonlinearities  is  to  include  higher-order  terms  in  the  Taylor  series 
expansion  about  the  reference  trajectory  (References  38  and  53).  This  leads 
to  computationally  unwieldy  correction  terms  in  the  filtering  algorithms. 

The  other  approach  is  to  use  some  "local  iteration*  algorithm  based  on  the 
extended  Kalman  filter  in  conjunction  with  the  use  of  one  stage  optimal 
smoothing.  By  local  we  mean  iteration  at  a  data  point  at  time  f  ,  or  in 
an  interval  [  f  ]  .  The  purposes  of  the  iteration  is  to  improve  the 


85 


reference  trajectory  and  thus  the  estimate  in  the  presence  of  nonlinearities. 

A  schematic  diagram  of  the  locally  iterative  process  is  shown  in  Figure  5-3. 

The  algorithni  is  obtained  by  linearizing  to  a  first  order  the  system 
and  measurements  around  the  best  estimate  at  each  data  point.  For  example, 
starting  at  t ^  with  and  P ^  ,  the  estimate  and  covariance  given  the 

data  up  to  time  t±  respectively,  we  linearize  and  predict  to  ,  the  time 

of  the  next  data  point  and  apply  one  iteration  of  the  extended  Kalman  filter. 
Based  on  this  new  estimate,  we  smooth  back  to  (one  stage  smoothing). 

The  smoothing  closes  the  loop,  providing  an  improved  reference  for  predic¬ 
tion  to  ,  and  the  extended  Kalman  filter  is  again  applied  at  data  point 

j  after  recalculating  the  extrapolated  covariance  and  gain.  The  iteration 
terminates  when  there  is  no  significant  difference  between  consecutive  itera¬ 
tions,  or  after  a  prespecified  number  of  iterations.  Experience  has  indicated 
rapid  convergence  of  the  algorithm:  rarely  have  more  than  two  additional 
iterations  been  required. 

Analysis  has  shown  (Appendix  H)  that  this  scheme  can  significantly 
reduce  the  bias  inherent  in  the  extended  Kalman  filter,  thereby  improving  the 
parameter  estimate  as  well  i  s  the  calculated  variance  of  the  estimation  error. 
Because  of  these  improvements,  reuse  of  the  entire  data  is  not  required  after 
a  complete  pass  is  finished,  thereby  eliminating  the  engineering  judgment 
inherent  in  increasing  the  variance  of  the  parameter  estimation  error  to 
recycle  the  data.  A  detailed  derivation  of  the  multi-corrector  extended 
Kalman  filter  algorithm  is  given  in  Section  5.2.  For  the  sake  of  easy  refer¬ 
ence  we  summarize  the  algorithm  below.  Notations  are  shown  in  the  list  of 
symbols. 

The  first  iteration  is  the  extended  Kalman  filter  and  the  one-stage 
smoothing  algorithm: 
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Denoting  *  and  ^  »  the  second  iteration 

and  iterations  thereafter  (i  =  2,  3. . . .)  are  given  by: 


(5.2) 
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5.1.3  Fixed -Point  Smoothing 


We  have  discussed  modern  data  smoothing  in  Section  III.  In  contrast 
to  the  filtering  discussed  above,  the  data  smoothing  is  concerned  with  the 
estimate  of  the  augmented  state  at  some  time  in  the  past  given  data  up  to  the 
present.  Since  the  response  caused  by  the  unknown  forcing  function  exerted 
on  the  system  at  time  t  will  be  contained  in  the  measurements  at  time  td>t 
further  "down  stream"  of  t  ,  it  is  obvious  that,  by  smoothing,  the  augmen¬ 
ted  state  estimate  can  be  improved  and,  further,  the  unknown  forcing  function 
can  be  estimated. 

Data  smoothing  can  be  classified  into  three  classes:  fixed-interval 
smoothing,  fixed-lag  smoothing,  and  fixed-point  smoothing.  Fixed-interval 
smoothing  is  concerned  with  the  estimation  of  the  state  at  some  time  t  be¬ 
tween  the  initial  time  t3  and  the  final  time  tf  given  all  the  data  up  to  ; 
fixed-lag  smoothing  is  concerned  with  the  estimation  of  the  state  at  some 
time  t  given  data  up  to  f  *  7”  for  some  fixed  value  7*  ;  and  the  fixed-point 
smoothing  is  concerned  with  the  estimation  of  the  initial  augmented  state, 
that  is,  at  t0  ,  given  data  up  to  some  time  t  . 

The  'ixed-interval  smoothing  algorithm  for  a  linear  system  was  first 
developed  in  the  early  sixties  by  Bryson  (Reference  1),  Rauch  (References  39 
and  40)  and  others.  Subsequently,  there  was  some  work  on  the  applications 
of  their  algorithms  to  problems  of  engineering  significance  (References  41 
and  54).  In  view  of  che  past  experience,  in  the  early  stages  of  this  project 
we  directed  our  efforts  toward  examining  more  or  less  exclusively  the 
feasibility  of  applying  the  fixed  interval  smoothing  techniques  to  VTOL  param¬ 
eter  identification.  Our  major  interest  was  to  see  if  it  is  feasible  to  improve 
the  model  of  the  v'TOL  aircraft  dynamics  by  examining  the  unknown  forcing 
function  that  can  be  obtained  from  smoothing  techniques.  It  was  found 
(Reference  55),  however,  that  the  fixed  interval  smoothing  algorithms  cur¬ 
rently  available  require  either  extremely  large  amounts  of  storage  for  the 
filtered  state  and  the  error  covariance  matrices,  or  have  computational  dif¬ 
ficulties. 
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Subsequently,  in  a  further  search  for  some  practical  ways  of  esti¬ 
mating  the  unknown  forcing  functions,  we  re-examined  the  entir-5  set  of 
smoothing  techniques,  and  it  is  our  belief  that  the  fixed-point  smoothing  lech 
nique  is  the  most  suitable  technique  for  estimating  the  initial  stale  and  the 
parameters,  and  from  them  to  start  the  estimation  of  the  unknown  forcing 
functions. 

In  contrast  to  fixed  interval  smoothing,  which  requires  a  complete 
filtering  pass  before  it  can  proceed  with  its  smoothing  pass  backwards,  the 
fixed-point  smoother  obtains  its  smoothed  estimate  as  the  filter  proceeds 
forward.  A  schematic  diagram  is  shown  in  Figure  5-4.  The  detailed  devel¬ 
opment  of  the  fixed-point  smoothing  algorithm  is  given  in  Section  5.2.  The 
basic  features  of  the  algorithm  are  that  no  storage  for  the  altered  state  and 
the  error  covariance  matrices  is  required,  as  the  algorithm  works  in  con¬ 
junction  with  the  multi-corrected  extended  Kalman  filter.  Furthermore, 
there  are  no  computational  difficulties  associated  with  this  algorithm.  Also, 
the  computation  of  the  unknown  forcing  functions  can  proceed  with  the  com¬ 
pletion  of  the  entire  pass  of  the  fixed-point  smoothing  estimate.  Conse¬ 
quently,  previous  difficulties  associated  with  fixed  interval  smoothing  are 
avoided. 


For  convenience,  the  fixed-point  smoothing  algorithm  is  given  below. 


where 


si.,  -  9,0;  [x- &,«,„]  r» ».  -p„ 

B  =  dummy  variables 

=  gain  matrix  of  the  last  local  iteration 
0  =  transition  matrix  of  the  last  local  iteration 

M  =  output  matrix  of  the  last  local  iteration 

13  =  measurement  error  covariance  matrix 

fp  =  initial  estimation  error  covariance  matrix 


R«idual=  J''4-'  (C# j 

and  the  superscript  "(f)"  denotes  the  last  local  iteration. 


(5.3) 
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5.  1.4  Computation  of  Unknown  Forcing  Functions 


To  achieve  the  goal  of  employing  the  best  possible  mathematical 
model  of  the  X-22A  in  transition  or  at  fixed  operating  point  (FOP),  we  need 
some  means  of  evaluating  the  errors  in  the  models.  If  we  have  the  capability 
of  determining  this  error  from  the  identification  process,  then  it  is  expected 
that  having  the  form  of  the  error  in  a  given  model  will  help  in  selecting  terms 
that  are  missing  and  thereby  help  to  improve  the  model. 

For  the  sake  of  analytical  simplicity,  we  regard  the  error  in  the 
assumed  model  as  a  white,  stationary  random  process  with  covariance  Q  . 
We  estimate  this  error  (called  unknown  forcing  function)  after  the  completion 
of  the  fixed-point  smoothing  part  of  the  analysis  for  the  initial  state  and 
parameters.  This  procedure  is,  from  a  computational  pc. int  of  view,  better 
than  the  conventional  approach  of  using  fixed-interval  smoothing. 


The  derivation  of  the  algorithm  for  computing  the  unknown  forcing 
function  is  given  in  Section  5.3.  Here,  we  simply  list  the  computational 
algorithm  for  it. 

^tlN  =  (  V///Y  '  *4 t-fj£-/ )  f°r  *  *  f>  ' '  * 

where 


ur4.\N 

vector  of  forcing  functions 

= 

with  initial  condition 

*o//vr  " 

fixed  point  smoothing  estimate 

represents  nonlinear  integration  from  f 

A 

which  is  the  smoother  gain  matrix  stored  on  a  forward 
filter  pass 
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p*/i-f  - 

**\k  - 
H-i\h  ‘ 


extrapolated  filter  covariance  matrix 

filtered  estimate 

one  stage  smoothed  estimate  for 


This  computation  is  performed  at  the  completion  of  a  forward  filter 
pass  and  the  fixed-point  smoothing  computation.  G ^  and 

computed  and  sorted  during  the  filter  pass. 

5.  1.  5  Better  Prediction  of  the  Quality  of  the  Estimated  Parameters 

A  very  desirable  feature  of  an  identification  technique  is  to  be  able 
to  predict,  with  reasonable  confidence,  the  accuracy  of  the  estimated  param¬ 
eters.  In  the  identification  technique  developed  for  the  VTOL.  parameter 
identification  program,  three  ways  are  used  to  judge  the  quality  of  a  set  of 
parameters  and  each  individual  parameter  of  that  set.  These  are: 

(a)  Transient  response  matching  to  measured  data. 

(b)  Identification  consistency  check  using  the  predicted 
residual  sequence  (measured  data  minus  the  predicted 
value)  during  an  identification  run. 

(c)  Variance  computation  of  estimated  parameters. 

A  discussion  of  each  check  follows: 

(a) _ Transient  Response  Matching. 

One  test  of  the  validity  of  an  identified  model  is  its  ability  to  reproduce 
the  measured  responses  (within  the  measurement  accuracy)  from  which  the 
parameters  were  originally  identified,  where  the  identified  model  includes 
the  estimated  unknown  forcing  term.  If  the  random  forcing  function  is  truly 
zero  and  the  form  of  the  model  is  correct,  then  the  model  should  also  match 
other  measurement  data  with  any  control  input. 


are 
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In  practice,  it  has  been  found  that  if  the  measured  responses  are 
insensitive  to  a  group  of  parameters  being  identified,  then  these  parameters 
are  likely  to  be  inaccurately  identified  even  though  a  model  using  these  param¬ 
eters  could  match  a  particular  measured  response  very  weli.  Thus,  a  good 
input  design  (Appendix  F)  and  transient  response  matching  to  data  with  dif¬ 
ferent  inputs  is  very  important. 

(b) _ Residual  Consistency  Tests 

Another  independent  measure  of  the  identification  technique  perfor¬ 
mance  is  to  perform  statistical  tests  on  the  predicted  measurement  residuals. 
The  residuals  are  the  differences  between  the  actual  measurements  and  pre¬ 
dicted  measurements.  If  the  assumed  noise  and  dynamical  models  are  fairly 
accurate,  these  residuals  should  be  small,  random,  zero  mean  and  should 
possess  statistical  properties  consistent  with  their  calculated  statistics.  For 
example. 


(5.4a) 


(5  4b) 


where  is  the  predicted  measurement  residual,  £  is  the  expectation 
operation,  and  Pg  is  the  covariance  of  .  We  can  then  plot  the  square 
root  of  the  diagonal  terms  on  the  righthand  side  of  (5.4b)  against  the  actual 
residual  sequence  to  see  if  the  filter  performs  as  it  predicts. 


(c) _ Improved  Variance  Computation 

Stan-up  procedure  for  the  locally  iterated  filter- smoother 


To  obtain  a  quantitative  measure  of  the  quality  of  each  parameter 
estimated,  the  variance  of  the  parameter  is  computed.  As  discussed  pre¬ 
viously,  the  initial  estimator  is  a  biased  estimator.  Also,  the  variances  of 
the  parameter  estimates  are  computed  by  the  initial  estimator  based  on 


classical  linear  regression  theory  with  nonstochastic  regressor  for  vise  in 
the  initial  covariance  matrix,  P  .  As  measurement  errors  are  always 
present,  the  regressor  is  in  actuality  stochastic,  and  the  variances  com¬ 
puted  for  the  parameter  estimates  are  only  an  approximation. 

From  experience  using  computer  generated  data,  where  the  noise 
levels  are  known,  it  has  been  observed  that  the  variances  of  the  parameter 
estimates  from  the  initial  estimates  are  in  most  cases  too  small  to  cor¬ 
rectly  represent  the  accuracy  of  the  parameter  estimates.  Best  results 
were  obtained  by  increasing  the  computed  variances  by  a  factor  of  from  1  to 
10  equally  for  all  the  parameters.  This  increase  is  necessary  to  account  for 
the  bias  of  the  initial  parameter  estimates,  as  it  forces  the  filter  to  place 
less  weight  on  these  estimates.  Although  the  variance  of  each  individual 
parameter  could  be  increased  by  different  factors,  the  computer  time  re¬ 
quired  to  obtain  the  best  combination  of  factors  by  experimentation  would  be 
formidable.  Furthermore,  the  best  factor  to  use  in  eacn  particular  situation 
is  not  known  in  general,  since  it  is  strongly  dependent  on  the  control  input 
and  noise  levels  present.  In  view  of  the  erroneous  variance  computation,  it 
is  doubtful  that  equally  increasing  the  variances  by  the  same  factor  is  appro¬ 
priate.  It  seems  more  appropriate,  therefore,  to  first  more  correctly  com¬ 
pute  the  variances  of  the  estimated  parameters  and  then  increase  them 
equally  to  keep  their  magnitudes  in  the  proper  proportion. 

A  better  scheme  to  start  up  the  Kalman  filter  from  initial  param¬ 
eter  estimates  is  to  calculate  P0  for  the  parameters  by  an  independent 
technique.  If  the  init'al  parameter  estimates  are  produced  from  an  efficient 
estimator,  then  the  covariance  matrix,  P0  ,  for  the  initial  parameter  esti¬ 
mates  can  be  shown  to  approach  the  Cramer -Rao  lower  bound,  02  .  There¬ 
fore,  the  following  equation  can  be  employed  in  the  calculation  of  the  improved 
start-up  covariance  .  Here,  the  matrices  and  hi-  are  evaluated 

along  the  trajectory  using  the  initial  estimated  parameters. 
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ce  -  £  £r  Hi 

-t=1 


where 


(5.5) 


~  2-i-i  > 


Since  the  inverse  of  is  the  sensitivity  matrix,  which  is  useful  for  input 
design,  the  initial  covariance  computation  has  also  been  coded  as  shown  in 
Figure  5-Z  into  s  separate  subprogram  for  input  design  purposes. 

V ariance  of  Fixed-Point  Estimated  Parameters 

The  covariance  matrix  for  the  fixed-point  smoothed  estimate  is 
shown  in  Section  5. Z  to  be 


where  8^  is  given  by 


(5.6) 


(5.7) 


Since  .he  iocally  iterated  filter-smoother  and  fixed-point  smoother 
employ  a  priori  information,  P0  ,  it  would  seem  that  the  above  equations 
could  be  employed  for  a  final  covariance  computation.  However,  the 
a  priori  information  for  P  in  the  case  of  parameter  estimation  is  almost 
always  unavailable  and  is  usually  produced  from  the  same  data  given;  in 
ether  words,  (P  is  obtained  after  processing  the  given  data.  As  such,  it  is 
not  a  priori  information  in  the  true  sense  in  that  it  is  independent  of  the  given 
data.  Rather,  the  P  obtained  through  using  the  data  should  be  regarded  as 
a  means  to  start  up  the  locally  iterated  filter-smoother.  Consequently,  it 
is  appropriate  to  compute  the  covariance  matrix  ot  the  fixed-point  esti¬ 
mated  parameters  in  an  independent  way  that  does  not  utilize  the  a  priori 
information. 


In  deriving  the  fixed-point  smoothing  algorithm  in  Section  5.Z,  we 
have  assumed  that  y-0,Y(£),  1-t.ic.-z  a/  are  jointly  Gaussian.  This  implies  that 
both  za  and  x0  jY(-t)  are  normally  distributed.  We  have,  therefore. 
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I  1  t(*,lYCN))t(Yto) 

n*0) 


(5.8) 


(5.9) 


and,  because  both  %0  and  1 Y (n)  are  Guassian, 

H*rU K,' 

Assuming  that  the  fixed-point  smoother  is  an  asymptotically  efficient  esti¬ 
mator,  then  without  use  of  a  priori  information,  the  covariance  of  the  param¬ 
eter  estimate  will  approach  the  Cramer- Rao  lower  bound  C.f?N  ,  which  is 
given  by 


a2  r 


2*. 


-A  ! 


(5.  10) 


From  equation  (5.9)  it  is  readily  shown  that 

<5.  Ha) 

Equations  (5.6),  (5.7),  and  (5.  11a)  are  the  desired  recursive  formulas  for 
computing  the  improved  covariance  matrix  of  the  fixed-point  smoothed  esti¬ 
mate  for  parameters.  It  can  be  shown  that,  in  the  absence  of  process  noise, 
equation  (5.  11a)  reduces  to 


ce  = 


V 

£ 


emu/"T 

t  t 


•  i  i 


(f) 


i-f 


(5.  lib) 


where 


,(() 


(f) 


.  SV. 


i-/  > 


In  the  next  three  sections,  detailed  mathematical  developments  are 
given  for  the  locally  iterated  filter- smoother  and  fixed-point  smoothing 
algorithm,  unknown  forcing  function  computation,  and  the  improved  com¬ 
putation  for  he  variances  of  the  estimated  parameters.  Readers  who  are 
not  interested  in  the  mathematics  can,  without  loss  of  continuity,  skip  these 
sections  and  go  directly  to  Section  VI,  in  which  the  results  of  the  numerical 
experiments  are  presented. 
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5.  I  Derivation  of  locally  Iterated  Filter-Smoother  and  Fixed-Point 

Smoothing  Algorithm 

In  this  section,  a  unified  approach  is  taken  to  derive  the  locally 
iterated  filter-smoother  and  fixed-point  smoothing  algorithm.  For  the 
readers  who  are  not  interested  in  the  detailed  mathematics,  this  section 
along  with  5.  3  and  5.-1  may  be  skipped  without  loss  of  continuity  in  going 
directly  to  Section  VI.  The  material  presented  in  this  section  is  purposely 
designed  to  be  seif-contained;  the  necessary  mathematical  preliminaries 
are  given  in  Appendix  G.  For  the  sake  of  convenience,  the  problem  as 
formulated  in  Section  II  is  restated  here;  however,  for  notational  simplicity, 
the  subscript  "  a.  "  in  equation  (3.9)  is  dropped. 

Statement  of  the  Problem 


Consider  the  nonlinear  continuous  system 

i  =  (5.  U) 

driven  by  zero  mean  white  Gaussian  noise,  ur(t)  ,  which  can  be  characterized 
by  the  difference  equation 

%i  (5.13) 

and  discrete  noisy'  measurements 

-  hi  (*i)  *  K  (5.14) 

where  qL(%(-i)  denotes  the  solution,  at  time  ti  ,  to 

j(t)  *  {($,*)  (5.15) 

given  the  initial  condition  =  V;-t  •  The  random  vector  sequences  u/t '• 

and  VL  are  white  Gaussian  with  zero  mean  and  covariance  matrices 


the  usual  rules  of  calculus  apply  (see,  for  instance.  Reference  56) 
correlated  noise  is  treated  in  Appendix  I. 
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The  process  noise  sequence,  ,  in  (5.  13)  i3  a  useful,  although  artificial, 
method  of  accounting  for  dynamical  modeling  errors  and  unknown  forcing 
inputs.  The  choice  of  a  normal  distribution  is  for  analytical  simplicity. 

The  initial  condition  x(t)  =  \  in  (5.  13)  is  a  Gaussian  random  variable  with 
mean  'H0  and  covariance  P0  ,  i.  e.,  £(%t)  =  N(x0JP0).  The  problem  is  to 
obtain  best  (efficient)  estimates  for  %0  and  url  ,  /  =  1,2, ...,N  using  the 
measured  data  V(/v)  ^[u7  ,uT , ,  u7)T. 

Fixed-Point  Smoothing  and  Locally  Iterated  Filter-Smoother  Algorithms 


The  problem  stated  above  is  a  problem  of  fixed-point  nonlinear 
data  smoothing  for  %0  and  fixed-interval  smoothing  for  ur  for  which  exact 
solutions  are  not  yet  available.  Our  objective  is  to  seek  an  approximate 
solution  to  the  above  problem.  To  this  end,  we  shall  assume  that  r,  ,Y(b) 
are  jointly  normal  and  so  are  j ,  Y(bj  ,  and  ,  Y  (.4)  for 

Note  that  this  assumption  is  true  only  if  (5.  13)  and  (5.  14)  are  linear,  thus, 
our  basic  assumption  is  oniy  an  approximation.  It  is  shown  in  Appendix  G 
that  the  conditional  expectation  £^-jY(f/)J  ,  £  are  the  efficient  esti¬ 
mators  (unbiased  and  minimum  variance)  for  and  given 

da*a  Y(n)  .  Using  equations  (G.  21}  and  (G.  ZZ)  in  Appendix  G  and  noting 
that  Y(fj)c(Y(M-t),y7J ,  it  is  readily  shown  that 

•—  (  ..  I  r~  (.  ln/j  .  n  ~ 


Ei*. 


where 


%IY(*) "  P*p(t-i) '  %  pgt  gA  % 

h  *  %-£X!y(*-')J 


j  =  0,i-1,b 


and  the  covariance  matrixes  «  ,  P~  -  are  defined  by 

*iyfc  'LL  Vi, 

P,A  ’  £'{b"eM  J  j 


(5,16) 


(5.  17) 


(5.  18) 


P*A  k  E I  [vek!yM j  [  ve/%/vM|fj 


(5.  19) 
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where  E-  is  the  expectation  operation.  Note  that  we  have  used  in  the  above 
expressions  the  fact  that  E  Y(£-t)}J  =0. 


Before  we  proceed  to  obtain  a  suboptima!  fixed-point  smoothing 
algorithm  from  (5.  16),  we  shall  first  use  equation  (5.  16)  with  j  =£-/,£  to 
derive  a  locally  iterated  filter-smoother  algorithm. 

j. 

Locally  Iterated  Filter-Smoother  Algorithm 

A  common  approach  is  to  employ  the  extended  Kalman  filter  to  per¬ 
form  the  estimation  for  .  However,  it  is  shown  (Appendix  H)  that  the 

extended  Kalman  filter  is  a  biased  estimator.  The  bias  is  due  to  the  multi¬ 
plicative  effect  of  nonlinearities  in  q-  and  h;  and  the  levels  of  noise  pre¬ 
sent  in  equation  (5.  12).  One  may  correct  for  system  and  measurement  non- 
linearities  by  including  higher-order  terms  in  the  Taylor  series  expansion 
about  the  reference  trajectory  (References  38  and  53).  However,  the 
approach  taken  here  is  to  use  some  local  iteration  algorithm  based  on  the 
extended  Kalman  filter  in  conjunction  with  the  use  of  one  stage  optimal 
smoothing.  The  putpose  of  the  locu1  iteration  is  to  improve  the  reference 
trajectory  and  thus  the  estimate  in  the  presence  of  nonlinearities.  Indeed, 
it  can  also  be  shown  formally  that  the  bias  is  reduced  by  the  local  iteration 
(see  Appendix  H). 


We  now  use  (5.  16)  to  first  derive  the  acally  iterated  filter-smoother. 
In  (5.  lb),  / '  W  j  is  the  one-stage  optimal  smoothed  estimate  for  f 

and  E  jv(V'j  is  the  optimal  filtering  estimate  of  .  Their  covariance 

\y(t.)  *  respectively.  First,  we  shall  ob- 


matrices  are  P„ 


ana 


tain  the  filtered  estimate  £  J  Y  (-ft,)  j  .  To  do  this,  we  need  E  Y(4L-t)\  , 

s!«*.v*4  ^ «*•  *«• 


An  equivalent  version  of  this  algorithm  has  previously  been  derived 
and  evaluated  by  Wishner  (Reference  57). 
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(0  Determination  of 


Consider  the  time  interval  t.  &t  .  Let  us  choose  a  nominal 

•k-i  *> 

trajectory  Z*(t),  which  is  the  solution  of  (5.  3  5)  with  initial  condition 
To  a  first-order  approximation, 

Ef iY»-')} 

-  *M-I  -  *i-l) 


4  *'/ 


(5.^1) 


where  f  (%j.  ,)  is  the  one  step  transition  matrix  along  2*(i). 

(ii)  Determination  of  E^y^jY(-i,-l)J 

We  linearize  (5.  14)  about  ~  2* (t^ )  .  To  a  first-order  approxi¬ 


mation 


where 


,  ,  ,  .  3^  GO 


(5.22) 


S'* 


Hence,  since 


*4 


EW\Y <*-!)]=  °> 

e  WVM  -  V  WX*^r  -  ) 


(5.23) 


(iii)  Determination  of  P„  ~  ,  £1  ~ 


Using  (5.  12),  (5.22),  (5.23),  and  (5.18), 

'  « 

Linearizing  9^  about  and  using  £(r^ ;J  *  X,± »  we  have: 

4  (**-»)  -  ^  [*«  (**•  ,)j  *  -s  te-r)(*t-r  -  H-ffc-r) 
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(5 .  £5' 


(5.26) 


Hence,  again  to  first  order, 

\u  ‘  e( [ C-,  (r* ■> ' *<■■/*•') H (V/  - n*r*\ 

*  p*y,  < 

*"•’  PV,  -  p*--  &Ur  *»£ 

«;  4  *w) . 

P4-f  =  [%-,-  *t-l\t-l  ] 

assuming  *£.//£.;  =  £.(*£_,)  •  Similarly, 

-  "1 

We  have,  therefore, 

pv%  “  py- h1t K pi/i-, 

4 1£ 

Thus,  based  on  the  chosen  trajectory  Z  (t)  fi^r  £  t  ±  t ^  >  with  end 

jf  |  A 

points  *  *£  *  the  filtered  estimate  ^  is 

e{x£'’Y '£)}  &  v* 


(5.27) 


(5.28) 


=  *•&/*-/  +  (X*4k-t-X*.) 

*4/s t-/  =  (*£J+  ^,6-;  (**-//*-/  ~  **-/) 


(5.29) 


where 


(5.  30) 


ind  is  given  in  (5.  28).  From  the  second  equation  in  (5.  16),  the  va 
of  the  estimate  is 

P4  =  py/6-r  ‘  P£/£-;  [H4  P4j4-f  Ht  *£*)  ^  ^M--/ 


variance 


(5.  31) 


Fii?are  5-5  shows  the  reference  trajectory  2* (t)  ,  its  end  points 
,  and  the  filtered  estimate  based  on  this  reference 
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trajectory.  Shown  also  ia  the  reference  trajectory  for  the  standard  extended 

A 

Kalman  filter  which  utilizes  the  reference  trajectory  with  end  points 
and  where 

Witn  this  choice  of  reference  traj<  ctory  it  is  readily  seen  that  (5.26),  (5.29), 
and  (5.  31)  reduce  to  the  extended  Kalman  filter: 

-*•  *  4  [u-k  (**i*j]  ' 

A  ~  K  P±lt-1  Hl  +Ri,V  (5.  32) 

p±k-t  =  $4,£-f%-t  $4,1 

P4  =  i1' 


J 

We  no v/  proceed  to  find  the  one-stage  smoothed  estimate  B^V^  tjY(^t)J 
using  the  same  reference  trajectory  2*(t)  t.  ±  t  £  i,  .  Denote  this  esti- 
mate  by  '  -From(5.  16) 

=  ** -M *  P%t-/  9*Pfc%b&  (5.3  3) 

Following  the  same  approach  as  above,  it  is  easy  to  see  that  to  a  first-order 
approximation 


P  ~  a  P  (f)*T  U* 
*4-tU  *■ 


(5.  34) 


ind  thus 


”  **->l*-r  *  f- ’*■>  Ki-I  Hl  (“l  %-<  ”*  *  K) 

,1  ‘  (5.35) 

-*fj] 

r,  equivalently, 


'  Xt  )] 


(5.36) 
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The  smoothed  estimate  is  shown  in  Figure  5-5.  The  covariance 

matrix  for  is,  from  (5.  16): 

°T,/t  ‘  P*:  -  P*.,  K  (5.  37) 

W  e  are  r.ow  in  a  position  to  discuss  the  procedure  of  the  locally- 
iterated  filter-smoother.  First,  before  processing  the  data  ,  we  choose 

the  initial  reference  trajectory  with  end  points  V'£./j£,j  »  •  With 

the  choice  of  this  reference  trajectory,  we  obtain  the  filtered  estimate  j 
by  the  extended  Kalman  filter  (Reference  18)  and  the  smoothed  estimate 
by  (5. 38), 

=  ^4-fjt-t  *  P4  l  (**/*-/)]  (5.  38) 


which  is  obtained  from  (5.  36)  by  replacing  %■*&./  and  by  f  and 

x±l-b-f  »  respectively.  Now,  after  the  data  y  is  processed,  the  estimate 

A  A 

fi^  and  should  be  more  near  the  true  trajectory.  Thus,  we 

'  A.  A 

choose  anc*  x4]i,  as  t^ie  enc*  P°tnts  of  the  second  trajectory  as 

shown  in  Figure  5-6.  Denote  j £  by  &£_f  •  We 

then  proceed  to  obtain  the  second  set  of  estimates  and  $£  fj£  using 

equations  (5.29),  (5.30),  and  (5.36).  In  doing  so,  of  course,  % ^  f  and 
are  replaced  by  and  respectively.  This  procedure  is  con¬ 
tinued  for  the  t’.ird  set  of  estimates  V  and  ^£j£  and  so  on,  until 

the  successive  estimates  of  are  "close  enough".  Experience  has  indi¬ 
cated  rapid  convergence  of  the  algorithm;  rarely  have  more  than  two 
additional  iterations  been  required. 


The  fixed-point  smoothing  algorithm  is  discussed  next. 

Fixed-Point  Smoothing  Algorithm 

V.  e  are  now  in  a  position  to  derive  the  desired  approximate  fixed- 
poinr  smoothing  algorithm.  Once  again  from  (5.  16)  , 


(5.39) 


EkM  - E[%oly(^p^tupth  & 

h  =y*.'E{<t*jy(*-f)} 


Observe  that  the  term  P~f  ^  in  (5.  39)  is  identical  to  that  in  the  filter- 
smoother  case  (5.  16).  Thus,  it  is  necessary  to  evaluate  only  the  term  P„  ~ 
in  (5.  39). 


As  in  the  case  of  the  locally  iterated  filter-smoother,  a  proper 
choice  of  reference  trajectory  is  required  for  better  linearization  of 
and  h£  in  (5.  12).  It  is  logical  to  choose  the  final  trajectory  used  in  the 
locally  iterated  filter -smoother  for  each  lime  interval  i 
Denote  the  final  trajectory  by  ■?  and  define 


C* 5  (C/j 

»?  4  «±(*3J 


etc. 


Then,  for  ~k  =  1, 

*  £(fa-{4 

•  P,  sgr  Kw 

The  gain**  for  fixed-point  smoothing  at  £  =  1  can  be  readily  obtained  from 
(5.27)  as 


%iph,  =?cV'w*r 


or,  equivalently. 


where 


p  ~  Di.f_  _  g  l/ 

P?  =  P  f  (r„  i/>  W  u  M  )T 

f  s>  -  /,<?  p  Mt  } 
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For  H  =  L, 


>*fc 


~  E~li'Xc'£(^)[yz-£(qzjY(,))Y  j 
*  £ ( (V Kic §(£  n'f) 


Since 


we  have 


and 


*■  * 

•I’ " 

%?z  “  p» i‘"'[i-!i1"V'ir}!wV®' 


P  ~  p„  k  _  p  <j  (f)T r}~' 
M 2  ^zf/z  F2W2 

where 

3  -  B,  $f[l-  tpfuf]  T 

In  genera],  for  any  £  a 


\h  %it  *W'V 


where 


Thus,  wo  have  the  following  suboptimal  fixed-point  Smoot  hire, 


**  *  *”M-’  *WV  -«g 


(*) 

tfeM 


(5.40) 


;  algorithm: 

) 

(5.41) 
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From  (5.41)  we  see  that  the  fixed-point  smoothed  estimate  is  again  computed 
in  a  recursive  manner  using  a  combination  of  old  estimates  and  new  data. 

The  residual  sequence  is  identical  to  which  is  the  final 

residual  sequence  in  the  locally  iterated  filter- smoother,  and  the  fixed- 
point  smoothing  gain  is  a  function  of  the  filter  gain.  The  fixed-point 
smoothing  algorithm  (5.41)  can  therefore  be  easily  mechanized  to  work  in 
conjunction  with  the  locally  iterated  filter-smoother  in  an  "on-line"  fashion. 

After  all  the  data  Y(n)  has  been  processed,  we  obtain  the  fixed-point 
smoothed  estimate  .  Using  this  estimate  and  the  filtered  estimates, 

an  estimate  of  the  unknown  forcing  term  u> ^  can  be  made.  The  computational 
algorithm  is  discussed  in  the  next  section. 


5.3  Computations  of  the  Unknown  Forcing  Function 


From  the  results  of  the  fixed-point  smoother,  xajN  ,  the  filtered 

estimate  and  the  constraint  equation  of  the  system  (5.  12),  it  is 

relatively  straightforward  to  derive  an  approximate  algorithm  for  estimation 

of  the  unknown  forcing  term,  ,  in  (5.  12).  This  estimate  v/ill  be  called 
a 

here.  However,  it  is  necessary  to  use  the  equation  for  the  fixed- 
interval  smoother,  »  defined  but  not  derived  above.  A  short  deriva¬ 

tion,  using  the  results  of  the  one^stage  smoothed  estimate,  follows. 


Using  a  well-known  matrix  identity,  ,  in  (5.28)  can  be  written 
as 

=  p? 

*  *  *  (5.4  2) 

where  all  symbols  were  defined  prev  •  'oiy.  Employing  (5.42),  (5.29), 
(5.31),  and  (5.36),  and  after  iengthy  algebraic  manipulations,  the  one -stage 
smoothed  estimate  may  also  be  expressed  by 


(5.43) 


where  the  *  and  -f  superscripts  have  been  dropped  fcr  convenience. 
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\\  c  shall  now  make  use  of  (5.43)  in  a  sequential  manner  to  obtain 

A 

Inc  fixed-interval  snK>other.  Suppose  tat  we  have  already  obtained 
via  (5.43),  it  represents  the  best  estiniate  we  have  concerning  the  state 
at  ic.  -  1  given  data  up  to  ~L  .  Now,  consider  the  smoothing  problem  of  a 
single-stage  transition  between  the  state  at  H  - 1  and  i:  -2  and  reapply 
■-5.43).  This  yields.: 

**+  ‘  ^  ^ ^  [  ^ 

where  and  have  replaced  and  »  respectively, 

in  (5.4  3). 

Therefore,  the  fixed-interval  smoother  becomes 

*  h-f/t-t  *  %-t  [  **///  '  **/£.,]  (5.  45) 

which  is  a  backward  recursion  starting  with  the  filter  estimate  £*,/„■ 

To  obtain  the  estimate  j ^  for  the  unknown  forcing  function 
applied  to  the  system  at  time  t,  ,  we  need  the  constraint  equation  for 
(5.45).  To  find  the  constraint  equation,  let  us  consider  (5.  12) 


Then; 


Kin  *  £{vdY(N)}mz{\Jt(*£- |  Y{N)} 


(5.  12) 
(repeat) 


(5.46) 


Now,  as  usual,  expand  fJ  about  the  final  one  stage  smoothed  esti- 

A 

mate  (note  that  the  superscript  {  has  been  dropped),  which  yields: 

S<  (**-,)  “  h  ( **/£.,) '$*, t;  (**.,-**->/*) 

Substituting  the  above  equation  into  (5.46),  we  have  the  desired  constraint 
equation  for  the  fixed- interval  smoothing: 
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(5.47a) 


tUr*\« 


or 


"tb  =  **/»- 4  (**-,/*  Ht 


(-  -  47b) 


Making  use  of  (5.45),  (5.  30),  and  (5.47b),  it  can  readily  be  shown  that 

*^£  Ptfe/£-/  fai/w  '  *■*.!*- 1)  (5.  48) 


Notice  that  the  form  of  (5.48)  is  identical  to  that  of  the  linear  case  (Reference 
30).  However,  it  should  be  pointed  out  that  P^j^.  ,  and  f  in 

(5.48)  are  the  final  values  in  the  locally  iterated  extended  Kalman  filter. 
Notice  also  that  if  is  available  for  ail  £  ,  (5.48)  will  suffice  to  esti¬ 

mate  the  unknown  forcing  function.  However,  at  the  completion  of  the  fixed- 
point  smoothing  we  have  only  Yqjn  ,  and  the  constraint  equation  (5.47b) 
and  (5.48)  must  be  reused.  We  have,  therefore, 

+  (V*/*  "**-//*)] 

Once  again,  using  (5.30),  we  have 

Then  (5.49)  finally  becomes 


(5.49) 


where 


Kfe/w  =  G4.  [x4i-i\n  ~  V-k-ilt-i) 


(5.  50a) 


(5.50b) 

A 


Note  that  the  gain  matrix  6^  can  be  precomputed  and  stored  along  with 
in  the  locally  iterated  filter- smoothing  pass. 
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Equations  (5.  5C)  and  (5.47a)  form  a  pair  of  difference  equation.' 

A  A 

which  are  recursively  solved  lor  ,  starting  with  • 


5.4  Improved  Covariance  Computation 

Variances  for  Fixed-Point  Estimated  Parameters 


The  covariance  matrix  for  the  fixed-point  smoothed  estimate  can  be 
readily  obtained  from  equations  (5.  39)  a*  d  (5.40)  as; 

=  ~  \v  K  i 


(5.  5i) 


where  8N  is  given  by  the  second  equation  of  (5.41), 


Since  the  locally  iterated  filter -smoother  and  fixed-point  smoother 
employ  a  priori  information,  P0  ,  it  would  seem  that  equation  (5.51)  could 
be  employed  for  a  final  covariance  computation.  However,  as  will  be  dis- 
c  issed  in  the  next  section,  the  a  priori  information  for  Pa  in  the  case  of 
parameter  estimation  is  almost  always  unavailable  and  is  usually  pro  iuced 
from  the  same  given  data;  in  other  words,  P0  is  obtained  after  processing 
the  given  data.  As  -"ch,  it  is  not  a  priori  information  in  the  true  sense  in 
that  it  is  independent  of  the  given  data.  Rather,  the  obtained  through 
using  the  data  should  be  regarded  as  a  mears  to  start  up  the  locally  iterated 
filter-smoother.  Consequently,  it  is  appropriate  to  compute  the  covariance 
matrix  of  the  fixed-point  estimated  parameters  in  an  independent  way  that 
does  not  utilize  the  a  priori  information. 


Recall  that  in  deriving  the  fixed-point  smoothing  algorithm  we  have 
assumed  that  %o  ,  V (i.),  1  £  !C  £  N  are  jointly  Gaussian.  This  implies  that 
both  ro  and  %3Iy(&.)  a  re  nor  nteclly  distributed.  We  ha^e,  therefore, 


f  &<">!%)  - 


((*JY("))  S(YM) 


and,  because  both  V  and  j Y(n)  are  Gaussian, 


(5.52) 
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■  -w«t  w«*»w*v  .vw  rs*'”f»v  -  ’■'rfi*-;  "*i' 


(5.53) 


* 

t 


Assuming  that  the  fixed-point  smoother  is  an  asymptotically  efficient  esti¬ 
mator,  then  without  use  of  the  a  priori  information,  the  covariance  of  the 
parameter  estimate  will  approach  the  Cramer-Rao  lower  bound  CE* 
(Reference  19)  which  is  given  by 

ce“ "  {£  I-* ‘M*)]} ' 

From  equation  (5.53),  it  is  readily  shown  that 

‘Ki™  -(tV 

Equations  (5.55),  (5.51)  and  the  second  equation  of  (5.41)  are  the  desired 
recursive  formulae  for  computing  the  improved  covariance  matrix  of  the 
fixed-point  smoothed  estimate  for  parameters.  It  can  be  shown  that  with 
=0,  i.  e. ,  Qi  »  s  ...  s  0  ,  equation  (5.  55)  reduces  to 


(5.54) 


(5.55) 


where 


as  .jj:  sf-YVn'"*”] '' 


z/"  =  §w 
4 


-(*) 

Ai~1 


>  ^ o 


«). 


(5.56) 


Start-Up  Procedure  for  Locally  Iterated  Filter  Smoother 

When  employing  the  equations -of-motion  estimator  as  the  initial 
start-up  procedure  for  the  Kalman  filter  on  computer  generated  data  (see 
Section  VI),  it  has  been  observed  tnat  the  variances  of  the  parameter  esti¬ 
mates,  which  are  used  as  the  diagonal  elements  for  %  computed  for  this 
estimator  were  not  consistent  with  the  parameter  estimates.  In  most  cases, 
the  variances  were  muck  too  small  to  indicate  the  accuracy  of  the  param¬ 
eters  estimated.  However  this  was  expected,  since  the  eq»iations-of- 
mction  estimator  is  a  simple  least  squares  technique  (equation  error  method) 
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with  ^nity  weighting;  and  we  have  shown  in  Section  II?  tuat  tnis  estimator 
gives  asymptotically  biased  estimate.,  when  measurement  errors  are  present. 
We  recall  also  that,  in  Section  3.  1,  the  variances  of  the  parameter  estimates 
were  computed  based  on  the  classical  linear  regression  theory  with  non¬ 
stochastic  regressor.  Since  in  actuality  the  regressor  is  stochastic,  the 
variances  computed  in  the  equations -of- motion  method  are  only  an  approxi¬ 
mation. 


From  experience  using  computer  generated  data,  where  the  noise 
levels  are  known,  best  results  were  obtained  by  increasing  the  computed 
variances  by  a  factor  of  from  1  to  10  equally  for  all  the  parameters.  This 
increase  was  necessary  to  account  for  the  bias  of  the  initial  parameter  esti¬ 
mates  by  forcing  the  filter  to  place  less  weight  on  these  estimates.  Although 
the  variance  of  each  individual  parameter  could  be  increased  by  different 
factors,  the  computer  time  required  to  obtain  the  best  combination  of  factors 
by  experimentation  would  be  formidable.  Further,  the  best  factor  to  use  in 
each  particular  situation  is  not  known  since  it  is  strongly  dependent  on  the 
control  input  and  noise  levels  present.  However,  in  view  of  the  erroneous 
variance  computation,  it  is  doubtful  that  equally  increasing  the  variances 
with  the  same  factor  is  appropriate.  It  seems  more  appropriate,  therefore, 
to  first  more  correctly  compute  the  variances  of  the  estimated  parameters 
and  then  increase  them  equally  to  keep  their  magnitudes  in  the  proper  pro¬ 
portion. 


Thus,  a  better  scheme  to  start  up  the  Kalman  filter  from  initial 
parameter  estimates  is  to  calculate  for  the  parameters  by  an  independent 
technique.  Assuming  that  the  initial  parameter  estimates  are  produced  from 
an  efficient  estimator,  then  the  covariance  matrix,  P0  ,  for  the  initial 
parameter  estimates  can  be  shown  to  approach  the  Cramer-Rao  (CR)  i.^.<*r 
bound.  Thus,  equation  (5.56)  can  be  employed  in  the  calculation  of  the 
improved  start-up  covariance  P0  .  Here,  of  course,  the  matrices  /.j 
and  .V  are  evaluated  along  the  trajectory  using  the  initial  estimated  param¬ 
eters,  i .  e. , 
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where 


ce  «fi 

j?  *  <B. .  .  Z.  t  t  Z.  - 1 

t  -*1,1-1  t-i  0 


(5.57) 
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Figure  5-2  Block  Diagram  of  the  CAL  Identification  Program 
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Figure  5-4  Fixed-Point  Smoother  Working  in  Conjunction 
With  Local  Iterative  Filter- Smoother 
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Figure  5-5  Reference  Trajectory 
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Figure  5-6  Updating  of  Reference  Trajectory 


SECTION  VI 


NUMERICAL  VERIFICATION  OF  ADVANCED  TECHNIQUES 

To  prove  the  concepts  and  to  verify  the  accuracy  of  the  developed 
identification  techniques,  computer-generated  data  were  used.  In  this  sec¬ 
tion  we  shall  describe  the  generation  of  thQ  data  that  were  used.  We  will 
then  discuss  the  results  of  applying  the  technique  to  these  data,  and  indicate 
the  effects  of  using  acceleration  measurements,  the  effects  of  reusing  the 
data,  the  effects  of  the  multi-correction  and  fixed-point  smoothing,  the 
effects  of  a  different  start-up  procedure,  and  finally  the  effects  of  the  noise 
covariances  (?  and  Q  .  In  lieu  of  exhaustive  Monte  Carlo  simulation  to 
fully  evaluate  the  performance  of  the  technique,  which  would  be  very  costly 
for  this  identification  problem,  the  criteria  of  performance  used  here  are; 

1)  the  accuracy  of  the  parameters  estimated,  and  2)  transient  response 
matching  to  measured  data. 

6.  I  Data  Generation 

Appendix  D  describes  the  computer-generated  data  employing  the 
linearized  equations  of  motion  and  Gaussian  noise  sequences.  The  flight 
conditions  were  chosen  to  be  at  a  fixed-duct  incidence  of  30“,  and  the 
resulting  data  were  designated  as  1A,  IB,  tC,  and  ID,  depending  on  the 
noise  levels  and  on  whether  or  not  process  noise  was  present.  Since  the 
equations  of  motion  that  best  describe  the  X-22A  aircraft  are  nonlinear  as 
discussed  in  Section  II,  more  data  were  subsequently  generated  to  study  in 
greater  depth  the  effects  of  nonlinearities  and  a  larger  number  of  param¬ 
eters  on  the  accuracy  of  the  developed  technique.  Again,  as  in  the  linear 
case,  independent  white  Gaussian  random  noise  sequences  with  zero  mean 
and  appropriate  variances  were  added  to  the  outputs  of  the  state  variables 
and  'he  accelerations,  simulating  measurement  noise.  In  addition,  the 
same  type  of  noise  sequences  was  added  to  the  vehicle  rep-esentation  in  the 
equations  of  motion  to  simulate  process  noise. 


Data  2A-1,  2C-1,  and  2D-1,  as  shown  in  Table  6- la,  were 


generated  using  an  input  (single  pulse)  in  the  longitudinal  stick  deflection 
alone.  Again,  the  flight  conditions  were  chosen  at  the  duct  incidence  of  30*. 
The  flight  conditions,  noise  levels,  and  the  true  parameters  used  for  data 
generation  are  all  shown  in  Table  6- la.  In  Table  6- la,  we  also  see  the  char¬ 
acteristics  of  the  set  of  data  2A-2  through  2D- 2  using  a  better  conditioned 
input  (multi-pulses)  in  the  longitudinal  stick  deflection. 

To  aid  in  the  evaluation  of  the  improved  techniques,  and  particularly 
the  improved  start-up  procedure,  and  to  serve  as  a  basis  for  application  of 
the  identification  technique  to  flight  test  data  at  FOP  (Fixed-Operating-Point), 
two  additional  sets  of  computer-generated  data  were  generated.  These  cases, 
called  3C-1  and  3D-1,  are  shown  in  Table  6- lb,  and  were  generated  without 
and  with  process  noise,  respectively.  The  noise  level  used  is  also  shown  in 
the  table.  The  model  in  etch  case  employed  linear  aerodynamics  with 
slightly  modified  ’’global'1  values  at  X  =  45*.  However,  in  these  cases, 
process  noise  was  considered  to  represent  equation  error  and  not  gust  effects 
as  in  the  previous  cases  (2A-1  through  2D-1,  2 C-2  and  2D-2  above).  Thus, 
the  process  noise  effectiveness  matrix,  gf  ,  in  (2.  15),  is  simply  -  I4  . 

A  realistic  longitudinal  stick  input,  taken  from  Flight  2F198  of  the  MPE  II 
data  (Reference  58)  was  used.  Detailed  descriptions  of  the  MPE  II  data  will 
be  given  in  Section  VII. 

The  measurement  noise  levels  used  were  obtained  by  observing  the 
oscillograph  records  of  the  MPE  II  data.  As  will  be  explained  in  Section  VII, 
these  levels  are  very  high.  In  addition,  the  standard  deviation  of  the  process 
noise  was  chosen  as  approximately  10%  of  the  RMS  (root  mean  square)  value 
of  the  acceleration  measurements,  thus  causing  a  very  high  value  for 

In  all  cases,  the  data  were  generated  on  the  computer  employing  a 
fourth-order  Runge-Kutta  integration  technique  with  a  fixed  step  size  (At  ) 
of  0.05  seconds  For  derivative  evaluations  between  data  points,  linear 
interpolation  wa,  ised  for  the  control  inputs,  but  the  process  noise  inputs, 
ur(t)  s  were  held  constant.  Since  At  is  sufficiently  small,  the  process 
noise  can  effectively  be  interpreted  as  forcing  the  dynamical  equations 
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through  a  sample  and  hold  network,  the  output  of  which  is  a  white  Gaussian 
sequence  whose  covariance  is  approximately  reduced  by  a  factor  of  <4/  from 
the  covariance  of  the  input  noise.  Following  this  interpretation,  the  process 
noise  standard  deviations  given  in  Table  6-1  are  those  prior  to  sampling  and 
holding.  Due  to  the  discrete  formulation  of  the  identification  algorithm,  no 
ambiguity  exists  for  the  measurement  error.  Refer  to  Appendix  D  for  a  more 
detailed  explanation. 

As  a  representative  case,  and  to  observe  the  effects  of  the  defined 
level  of  process  noise  on  the  measured  responses,  data  generated  for  3C-1 
and  3D-1  are  shown  in  Figures  6-1  and  6-2,  respectively.  Responses  for 
U/  ,  and  q  (labeled  as  ul*  ,  uf* ,  and  c£  ),  although  not  used  as  mea¬ 
surement  sources,  are  shown  along  with  the  simulated  measurements  -  £  , 

9 ,  u,  ,  ur  ,  ,  T)^  ,  and  $  . 

6.2  Effects  of  Using  Acceleration  Measurements 

Longitudinal  acceleration  measurements  £  ,  ,  and  contain 

additional  information  concerning  the  excitation  and  motions  of  the  aircraft. 
The  parameters  identified  using  the  acceleration  measurements  in  addition 
to  the  state  variable  measurements  would  therefore  be  expected  to  be  more 
accurate  than  those  identified  using  only  the  state  variable  measurements. 

Table  6-2  i-hows  a  comparison  of  the  results  obtained  from  the 
extended  Kalman  filter  with  and  without  acceleration  measurements  on  data 
case  2D-2.  The  initial  parameter  estimates  were  from  the  equations-of- 
motion  estimator,  and  the  initial  variances  ci  these  estimates  (which  were 
calculated  from  the  equations -of-  'lotion  estimator  using  (3.  3d)  )  were 
multiplied  by  a  factor  of  10  to  initialize  the  Kalman  filter.  In  both  identifica¬ 
tion  runs  on  data  2D-2  with  ar.d  without  acceleration  measurements,  the 
initial  conditions  for  the  aircraft  states  (  ^  ,  &  ,  u.  ,  and  ur )  were  set 
equal  to  the  first  point  in  the  measurements,  and  their  initial  covariances 
were  set  equal  to  the  measurement  noise  present  on  these  sensors.  (Note: 


118 


this  procedure  was  followed  for  all  identification  runs  in  this  section.) 

Notice  that  the  parameter  estimates  are,  in  general,  closer  to  the  correct 
values  for  the  runs  with  acceleration  measurements  than  for  those  without. 
The  improvement  in  accuracy  is  not  drastic,  however,  which  perhaps  is  a 
result  of  conditioned  input  and  the  fact  that  the  total  noise  level  present  on 
the  acceleration  measurements  {which  Includes  the  contribution  added  by  the 
process  noise)  is  large  relative  to  the  noise  level  in  the  other  state  mea¬ 
surements. 

Unfortunately,  introducing  acceleration  measurements  into  the 
extended  Kalman  filter  increases  the  computational  load  by  a  large  amount, 
because  the  size  of  the  matrix  required  for  inversion  at  each  data  point  is 
equal  to  the  number  of  time  histories  used  and  also  because  the  measure¬ 
ments  now  become  nonlinear  functions  of  the  aircraft  state  and  parameters. 
Using  acceleration  measurements  in  addition  to  <  ,  Tiate  variable  measure¬ 
ments,  the  number  of  time  histories  increases  from  4  to  7,  which  requires, 
among  other  things,  inverting  -7x7  matrix  instead  of  a  4  x  4  matrix  at 
each  data  point.  Proper  scaling  of  the  variables  and  parameters  is  also 
required  to  avoid  ill-conditioned  numerical  situations  (large  differences  in 
order  of  magnitude).  It  was  found  that  the  best  combination  of  units  was 
ft/sec2  for  and  and  degrees  for  all  angular  units. 

The  transient  responses  computed  from  these  two  sets  of  identified 
parameters  (Table  6-2)  matched  very  well  with  the  measurements.  These 
responses  are  shown  in  Figure  6-3  for  the  cas;e  in  which  acceleration  mea- 
suremenlr.  were  used;  those  of  cases  without  acceleration  measurements 
were  essentially  identical.  Due  to  the  very  high  signal  to  noise  ratio 
(which,  incidentally,  is  very  unrealistic  and  ccnr.ot  be  obtained  in  flight 
because  of  the  large  excursions  of  the  aircraft  motion),  the  transient  re¬ 
sponses  computed  using  the  initial  estimated  parameters  (from  the  equations- 
of- motion  method)  also  match  very  well. 
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Effects  of  Reusing  Data 


6.  3 


Since  the  parametet  identification  of  a  VTOL  aircraft  is  a  post¬ 
flight  data  analysis  problem,  it  is  possible,  of  course,  to  reuse  *he  same 
flight  data.  Further,  since  the  extended  Kalman  filter  is  a  biased  estimator 
for  parameter  identification  problems  (see  Appendix  H)»  it  is  desirable  to 
reuse  the  same  data  all  over  to  reduce  the  bias  of  the  estimate.  In  our  early 
development  of  identification  techniques  employing  the  extended  Kalman 
filter,  we  were  therefore  forced  to  utilize  a  recycling  scheme  to  improve 
the  parameter  estimates.  This  scheme  essentially  considered  the  first  pass 
through  the  extended  Kalman  filter  as  the  second  initial  estimator  (the 
equations-of-motion  method  being  the  first  initial  estimator)  for  the  second 
pass  of  the  extended  Kaiman  filter,  which  then  refiltered  the  data  in  a  forward 
fashion  (  tQ  to  ).  An  alternate  way  of  reusing  the  data  is  backward 
filtering.  Again,  we  may  consider  the  forward  pass  as  the  second  initial 
estimator  for  the  second  extended  Kalman  filter  (the  backward  filter),  which 
filters  the  data  from  to  tg  .  These  two  schemes  of  repeatedly  using  the 
extended  Kalman  filter  are  shown  in  Figure  5-1.  It  is  important  to  point 
out  that  both  second  filters  are  extended  Kalman  filters,  and,  therefore,  the 
second  filter  is  again  a  biased  estimator  just  as  the  first  filter.  As  we  have 
discussed,  the  locally  iterated  filter- smoother  subsequently  developed  cir¬ 
cumvents  this  difficulty  of  needing  to  reuse  the  data. 

Tabie  6-3  shows  a  comparison  of  typical  computer  runs  of  the  two 
schemes  of  reusing  the  data,  both  using  acceleration  measurements.  The 
data  used  are  muiti-puises  in  §es  ,  with  both  moderate  process  and  mea¬ 
surement  noise  (data  ZD-Z).  From  this  table,  it  can  be  seen  that  the  second 
filter,  either  forward  or  backward,  does  not  substantially  improve  the 
parameter  estimates.  This  fact  may  be  partly  attributable  to  the  fact  that, 
the  initial  estimator  has  already  given  a  good  parameter  estimate  for  this 
type  of  input. 
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6.4  Effects  of  Multi-Corrections  -  The  Use  of  Locally  Iterated 

Filter -Smoother 

Table  6-4a  shows  a  comparison  of  the  parameter  estimates  re¬ 
sulting  from  the  above  schemes  of  reusing  the  data  in  the  extended  Kalman 
filter  with  the  results  of  a  simple  version  of  the  locally  iterated  (or  multi- 
corrected)  extended  Kalman  filter  on  data  case  2D-2.  In  these  computer 
runs,  as  before,  acceleration  measurements  were  utilized.  The  last  column 
in  Table  6-4a  is  case  F1g  (l)»  in  which  a  simplified  multi-corrector  (no 
optimal  one-stage  smoothing,  only  one  additional  local  iteration)  was  used. 
From  Table  6-4a  we  see  that  the  parameter  estimates  are  slightly  more 
accurate  than  the  two  schemes  of  reusing  the  data.  From  Tables  6-3  and 
6-4a,  a  comparison  can  also  be  made  between  this  simple  version,  fj*  (f) , 
and  the  extended  Kalman  filter,  ,  with  no  recycling.  Again,  the  dif¬ 

ferences  are  very  small,  indicating  the  initial  parameter  estimates  are 
accurate  enough  to  require  little  or  no  improvement  in  the  reference  tra¬ 
jectory  from  the  additional  correction.  Again,  ail  transient  responses  are 
equivalent  to  those  in  Figure  6-3. 

The  effects  of  the  multi-correction  can  be  seen  more  clearly  from 
Table  6-4b.  The  data  used  here  are  not  well-conditioned  (single  pulse  in  ^<5 
with  moderate  measurement  noise).  Further,  because  of  the  fact  that  the 
data  have  no  process  noise  added  (case  2C-1),  the  simplified  version  of 
multi-correction  is  identical  to  a  better  version  which  incorporates  optimal 
one-stage  smoothing.  From  this  table  it  is  seen  that  the  results  of  two 
additional  local  iterations  improve  significantly  the  estimate  of  the  param¬ 
eters.  It  can  also  be  seen  that  improvements  can  be  made  with  different 
choices  of  P0  ,  the  initial  covariance  matrix  of  the  estimated  parameters. 
Typical  transient  responses  are  shown  in  Figure  6-4. 

+  This  simplified  version  of  multi-correction  was  programmed  for  the 
case  where  process  noise  was  absent.  One-stage  smoothing  then  be¬ 
comes  backward  prediction,  which  is  simply  an  integration  of  the 
dynamical  equations  backward  one  data  point  from  the  filtered  estimate. 
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The  same  comparison  is  made  in  Table  6-4 r.  for  data  case  2D- 1 
employing  the  correction  with  one-stage  smoothing.  As  shown,  no  improve¬ 
ment  is  ob'ained  for  this  data  sel;  however,  it  is  again  noted  that  the  param¬ 
eter  estimates  are  very  sensitive  to  P0  .  Transient  responses,  represen¬ 
tative  of  all  three  sets  of  parameter  estimates,  are  giv°n  in  Figure  6-5. 
Results  of  the  fixed-point  smoothing  algorithms  working  in  conjunction  with 
the  locally  iterated  filter  will  be  discussed  below. 

Table  6-5  shows  the  effects  of  multi-correction  for  data  case 
3D-1.  The  acceleration  measurements  were  used  and  the  multi-corrector 
used  was  the  one  with  optimal  one-stage  smoothing.  The  results  show  that 
one  additional  correction  improves  the  parameter  estimates.  Transient 
response  matching  t o  data  case  3D-1  is  shown  in  Figure  6-6.  The  improve¬ 
ment  in  response  matching  over  the  time  histories  computed  using  the 
parameters  estimated  from  the  equations -of- motion  method  is  clearly  indi¬ 
cated  in  this  figure. 

From  Tables  6-4b  and  6-4c,  it  is  evident  th-t  the  parameter  esti¬ 
mates  using  the  locally  iterated  filter- smoother  are  very  sensitive  to  the 
choice  of  the  initial  covariance  matrix  Pc  .  Evaluation  of  a  better  choice 
of  PQ  as  discussed  in  Section  5.4  is  given  in  the  next  subsection. 

6.5  Effects  of  Different  Start-Up  Procedures 

From  the  preceding  discussions  and  tables  associated  with  eval¬ 
uating  the  locally  iterated  filter,  it  is  apparent  that  the  final  parameter  esti¬ 
mates  are  very  sensitive  to  the  initial  covariance  matrix  P0  .  This  fact 
caii  be  seen  in  Table  6-4h  for  data  case  2C-1,  where  thvee  sets  of  param¬ 
eter  estimates  are  obtained  from  the  locally  iterated  filter  by  increasing 
eruady  c’l  the  variances  of  the  initial  parameter  estimates  (from  the 
eqi.ac<ons-of-motion  estimator)  by  factors  of  1,  10  and  100.  The  results 
obtained  from  using  a  factor  of  10  are  better  in  the  X  and  Z  derivatives 
than  those  from  vising  1,  but  are  not  as  good  in  the  momert  derivatives. 
Clearly,  no  uniformly  better  set  of  parameters  is  obtained  by  increasing 
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all  of  the  Initial  variances  computed  from  (3-3d)  by  the  same  factor  . 
Furthermore,  the  proper  amount  of  increase  for  each  parameter  is  dependent 
on  the  control  input  and  noise  levels  present.  These  numerical  results  con¬ 
firm  the  desirability  of  employing  the  proposed  start-up  procedure  discussed 
ia  Section  5.4. 

Since  the  CR  lower  bound  given  in  equation  (5.57)  is  computed  in 
the  quasilinearization  identification  algorithm,  which  has  been  previously 
evaluated  (see  Section  3.2),  this  algorithm  was  used  to  evaluate  the  pro¬ 
posed  new  start-up  procedure  on  data  3C-1  and  3D-1,  which  have  a  smaller 
number  of  parameters  than  data  2C-1  and  2D-1.  A  comparison  is  made  in 
Table  o-6a  between  (from  equations -of- motion  estimator),  er..e  (CR 

lower  bound  standard  deviation),  and  the  absolute  estimation  error  for  data 
3C-1  and  3D-1.  Here  the  absolute  estimation  error  is  the  absolute  dif¬ 
ference  between  the  true  parameter  value  and  the  parameter  estimate  from 
the  initial  estimator.  The  CR  bound  was  computed  in  the  quasilir.earization 
program  and  increased  by  a  factor  of  20.  As  is  evident,  the  absolute  esti¬ 
mation  error  is  generally  within  the  2ffce  value,  which  demonstrates  that 
this  method  of  computing  the  initial  variances  gives  a  better  indication  of 
the  initial  parameter  estimate  quality  than  dees  the  equations -of-moti^n 
estimator. 


Results  presented  in  Table  6-6b  are  for  data  case  3D-1.  Here 
the  lower  bound,  CR,  was  computed  as  given  by  (5.57).  Included  in  the 
table  is  a  comparison  between  the  extended  Kalman  filter  ( )  and  the 
locally  iterated  filter  (F,(f)  )  with  one  iteration,  starting  with  Pe  for  the 
parameters  from  the  equations -of- motion  estimates.  This  comparison  has 
already  been  discussed  and  shown  m  Table  6-5  and  thus  will  not  be  dwelled 
upon  further. 

*  The  same  situation  can  be  seen  from  Table  6-4c,  which  utilized 
data  set  2D-1,  and  Table  6-5,  which  utilized  data  set  3D-1. 
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Also  shown  are  the  results  from  the  fixed- point  smoothing  algorithm, 
for  both  the  initial  aircraft  states  and  the  parameters  employing  the  improved 
start-up  procedure  with  a  factor  of  20.  The  fixed-point  smoother  was  working 
in  conjunction  with  the  locally  iterated  filter  using  one  iteration.  A  final 
variance  computation  for  these  estimates  as  discussed  in  Section  5.4  and 
computed  by  (5.  57), is  given  by  6- (standard  deviation). 

The  results  are  very  impressive.  Comparing  the  smoothed  param¬ 
eter  estimate  with  the  locally  iterated  filter,  we  see  a  substantial  improve¬ 
ment.'  The  filtered  parameter  estimates  are  shown  as  a  function  of  time  in 
Figure  6-7.  Transient  response  matching  to  measured  data  is  equivalent  to 
the  case  in  Figure  6-6.  The  final  variance  computation  for  these  estimates 
also  agrees  very  well  with  the  error  in  the  estimates.  In  most  cases,  the 
magnitude  of  the  absolute  estimation  error  is  within  the  2s  value  obtained 
from  the  final  variance  computation. 

Improved  accuracy  may  be  possible  by  equally  increasing  the 
initial  variances  from  the  CR  computation  by  a  different  factor  to  form  P0  . 
The  best  factor  to  use  could  be  obtained  by  additional  experimentation; 
however,  time  constraints  did  not  permit  further  development  of  the  start-up 
procedure. 

6.6  Fixed-Point  Smoothing  Results 

The  fixed-point  smoothing  algorithm  developed  in  Section  5.2  has 
been  applied  to  data  cases  2D-1  and  3D-1.  The  results,  as  indicated  on 
Tables  6-4b  and  6-6c,  have  shown  that  the  smoothed  parameter  estimates 
and  filtered  parameter  estimates  are  approximately  the  same.  A  close 
examination  reveals  that  this  weak  "s moothability"  of  the  parameters  is  at¬ 
tributable  to  the  low  ratio  of  process  noise  to  measurement  noise  considered 
in  these  cases.  An  augmented  state  is  considered  smoothable  if  smoothing 

*  This  comparison  can  be  made  because  the  parameters  are  only 
slightly  smoothable  (see  next  section). 
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of  the  data  yields  an  estimate  of  the  state  which  is  different  from  that  which 
would  be  obtained  by  integrating  the  final  filtered  state  estimate  (at  tf  ) 
backward  in  time  (Reference  41).  For  the  parameter  identification  problem, 
the  parameters  to  be  identified  are  considered  constant  states,  and  therefore 
the  filtered  and  smoothed  parameter  estimates  will  be  equal  only  if  the  param¬ 
eters  are  not  smoothable. 


f 
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From  the  equations  for  the  fixed-point  smoothing  algorithm  or  the 
fixed -interval  smoothing  algorithm,  which  are  given  in  Sections  5.  2  and  5.  3, 
and  the  form  ol  the  state  transition  matrix  between  data  points,  it  can  be 
shown  that  the  improvement  which  smoothing  gives  over  filtering  is  strongly 
dependent  upon  the  ratio  of  the  levels  of  process  noise  to  measurement  noise 
present  although  the  proof  of  this  observation  is  by  no  means  trivial.  As  an 
intuitive  example,  however,  let  us  look  at  the  relative  magnitudes  of  the 
process  noise  to  measurement  noise  present  in  data  set  3D-1.  Since  the 
measurement  system  is  discrete  whereas  the  dynamics  are  continuous,  the 
comparison  is  properly  made  by  comparing  the  magnitude  of  the  elements  of 
Q,  for  a  discrete  process  noise  sequence,  to  the  elements  of  R  ,  the  mea¬ 
surement  noise  covariance  matrix  which  includes  the  effects  of  process  noise 
in  the  acceleration  measurements. 

From  Table  6- lb,  we  have 


125 


Judging  from  the  magnitude  of  the  elements  of  R  and  Q.  then,  the  param¬ 
eter's  are  expected  to  be  only  slightly  smoothable  for  da  la  case  3D-1;  as 
confirmed  by  numerical  results.  The  same  situation  applies  for  data  case 
ZD-l,  except  here  the  analysis  is  more  complicated  because  the  process 
noise  is  not  stationary. 

6.  7  Residual  Consistency  Test 

An  essential  feature  of  an  identification  technique  is  to  be  able  to 
predict,  with  reasonable  confidence,  the  accuracy  of  the  estimated  param¬ 
eters,  If  more  than  one  set  of  parameter  estimates  are  available,  either 
from  the  same  measurement  data  or  different  measurement  data  with  dif¬ 
ferent  control  inputs,  then  a  judgment  is  required  to  determine  which  param¬ 
eter  set  is  the  most  accurate,  or  which  combination  of  these  parameter  sets 
would  give  the  most  accurate  set. 

As  a  means  of  evaluating  the  accuracy  of  the  estimates,  transient 
response  matching  to  measured  data  and  an  improved  final  covariance  com¬ 
putation  for  the  parameter  estimates  have  been  employed.  Also,  an  improved 
sta.rv-up  procedure  for  calculating  Pg  has  been  proposed  in  order  to  obtain 
more  accurate  parameter  estimates.  This  start-up  procedure  has  had 
limited  evaluation  on  computer  generated  data  where  the  measurement  noise 
and  process  noise  levels  are  known. 
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However,  when  using  the  locally  iterated  filter  and  fixed -smoothing 
technique  on  actual  flight  data,  the  actual  values  of  R  and  Q  to  use  in  the 
algorithm  must  be  determined  by  engineering  judgment.  R  can  usually  be 
obtained  readily  from  the  measured  data  but  Q  is  net  as  easily  chosen. 

Since  the  improved  start-up  procedure,  the  final  covariance  computation  and, 
of  course,  the  final  parameter  estimates  -  either  indirectly  through  the  com¬ 
putation  of  P0  or  the  sensitivity  of  the  estimates  to  R  and  Q  (see  Appendix 
K)  -  depend  upon  the  selected  values  for  R  and  Q,  a  performance  measure 
to  aid  in  the  selection  of  these  matrices  is  very  important. 

A  measure  of  the  identification  technique  performance  can  be  made 
by  performing  statistical  tests  on  the  predicted  measurement  residuals 
(innovation  sequences),  which  are  the  differences  between  the  actual  measure¬ 
ments  and  predicted  measurements  during  the  filter  operation.  These 
residuals  are  defined  as  y^  in  Section  5.  2  for  the  locally  iterated  filter. 
From  equations  (5.  17),  (5.27),  and  (5.29),  we  have 


Thus,  if  the  assumed  noise  covariances  (  R  and  Q  )  and  dynam¬ 
ical  model  are  fairly  accurate,  these  residuals  should  be  small,  random, 
zero  mean  and  should  possess  statistical  properties  consistent  witn  their 
calculated  statistics,  Pg  .  Although  the  residual  sequence  provides 
a  convenient  way  of  adaptively  estimating  Q  and  R  as  filtering  proceeds 
(Reference  31),  the  approach  taken  here  is  to  use  them  to  provide  an  indicator 
for  determining  if  the  R  and  Q  were  set  properly.  If  not,  R  and  Q  can 
be  readjusted  and  another  identification  run  made. 
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Figure  6-1  Computer  Generated  Data  3C-1 
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Figure  6-4  Transient  Response  Matching  to  Data  2C-I,  Typical  Kalman 


Figure  6-5  Transient  Response  Matching  to  Data  2D-1,  Typical  Kalman 
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+  Measured  Data 
o  Response  Using  Parameters 
from  EOM  Estimates 
—  Response  Using  Parameters 
from  Multi-Corrected  Filter 


Figure  6-6  (continued) 
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Figure  6-7  Filtered  Estimates  (States  and  Parameters)  Data  3D- 
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Figure  6-8  Residual  Sequence  for  R  and  Q  True  Data  3D-1, 


f'cR<l)  Filter 
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TABLE  6-la:  Computer-Generated  Data  Characteristics  for 

Data  2A-1,  2 B-l.  2C-1,  2D-1  and  2A-2  Through  2D- 
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TABLE  6  -la  (con't. ) 

Computer-Generated  Data  Characteristics  lor 
Data  2A-1  Through  2D-1  and  2A-2  Through  2D-2 


Flight  Conditions 


x  :  3oo 

Ua  r  130  fps  ^  =  5.362  fps 

o 

fi0  -  1 7. 26°  q,  =  o 

637  in. 

O 

G.W.  =  14,  364  1b  Altitude:  Sea  Level  STD 


Control  Inputs 


2-A-l 

2-B-l 

2-C-l 

2-D-l 


2-A-2 

2-B-2 

2-C-2 

2-D-2 
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Computer-Generated  Data  Characteristics  for 
Data  3C-1  (Measurement  Noise  Only)  and 
3D-1  (Both  Process  and  Measurement  Noise) 


Noise  Levels 


M  E  AS  U  R  E  M  ENT  NO  IS  E 

SENSOR 

STANDARD 
DEVIATION  O 

i  .<?  A 

. 22  deg /sec 

.  .  0  _ 

.  09  deg 

i  U 

2.6  ft /sec 

.  15  deg 

.012g 

H . . 

.  . -05g 

4 

2 

2. 3  deg/sec 

ur 

1 . 0  ft/sec 

PROCESS  NOISE 

NOISE 

VALUE 

.  ,  (  2 
. 4  deg/sec 

<*& 

.  1  ft/sec^ 

cr. 

ur 

2 

3. 2  ft /sec 

Measurement  Noise  is  any  random  fluctat>ons  and/or  uncertainty 
in  a  measurement  output  (white  or  correlated). 


Process  noise  is  used  here  to  approximate  unknown  driving  forces 
and  to  account  for  inaccuracy  in  modeling  the  dynamics  of  the 
aircraft. 
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TABLE  6-2 


Kalman  Filter  Estimates  With  and  Without 
Acceleration  Measurements 


T rue  Value 

Data  2D-2;  Multi-Step  <f  With  Process  Noise 

*  fj 

parameter 

With 

W  ithout 

Equations  of 

Accelerations 

Accelerations 

Motion 

F .  „ 

1 0 

F10 

f*  \ 

.  50518 

.  30828 

.40586 

. 39796 

M 

1  u  I 

-.00308 

.  000884 

-.000589 

-.000391 

0 

-6.  2  x  10'6 

-2.467  x  10~5 

-. 00001961 

-2. 057  x  10"5 

-.001747 

-.00271 

-.002955 

-.003088 

-5.53  x  10‘D 

-4.  97  x  10"° 

-.00004714 

-4. 64  x  10'5 

ft  \ 

-.497 

-.5924 

-.57211 

-.58733 

Af 

l  ) 

-5 

-.0000203 

4 

i  u> 

-.00103 

4.fa84  x  10 

-.000197 

(<  \ 

.  3275 

.  33012 

.  31575 

. 32378 

. 001167 

.  001131 

. 001273 

. 001218 

18.  30 

17.  899 

13.427 

18.  340 

j  « 

-.OS '67 

-.0872 

-.09353 

-.09466 

^  uzl 

-.0003 

-.000306 

-.0002976 

-.000268 

^ur 

l’\ 

.  2211 

.  20523 

.21955 

. 17575 

-. 001587 

-.001455 

-.001560 

-.001185 

^8 

U/ 

- .  778 

.0184 

-.4563 

.  01604 

-. 71386 

.01841 

-.78528 

. 01843 

-32.  17 

-31.  14 

-37.2157 

-32. 78 

(*  ) 

.910 

.  9081 

1. 0336 

.  9451 

[  U*J 

-.  007 

-.007008 

-. 097664 

-.00722 

f) 
L  / 

-. 2939 

-. 36993 

- . 36o0 

-.0028’. 

-.002316 

-. 002302 

ill 

/n 

- . 3507 

-1. 2589 

-1.9496 

-1. 0546 

** 

( 

. 01667 

. 023506 

_ 

. 031203 

. 02467 

Perturbed  value;  moment  derivatives  in  rad/sec 
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•  the  1st  forward  pass  with  the  variances  of  parameters  obtained  from  the 
equations  of  motion  method  multiplied  by  10. 
backward  filtering 


T3 

*-* 

fd 


r3 

-r 

i 

W 

CQ 

< 


t-  « 

y  t. 


5  s 

u<  o 


rt 


s 


13 

-c 

« 


a 

E 

<n 


* 


146 


3 

I 


7 

1 


$ 


1 

I 

I 


juvjiunvty.ii^ .WVJH ■,.)'< W^jwwj-?WH!WWPI.UII , ,, ■  .., ,  j, ,Mn wrn>wjtmmmwnwi 


i  fe- 


r 


v* 


I 


i 

l 


i 

I 


K 


t 


i 

S 


l 

! 


o 

c 

e 

V 


.n 

•* 

I 

-o 

W 

fi 

c 

H 


i 

U 

<M 

a> 

m 

rtl 

O 

>4 

o 

VI 

C 

O 

V 

+J 

U 

a> 

k 

k 

o 

U 

i 


3 

2 

V 

JS 


o 

to 

«■» 

o 

a 

VI 

V 

w 


a> 

k 

3 

« 

a> 


rt 

k 

V 

TJ 

O 

£ 


c 

o 


in 


v 

n 

H 

3 

Ou 


60 

C 


l 

U 

iM 


3 

rt 

Q 


•» 


147 


with  acceleration  measurements 


TABLE  6 -4c 


EFFECTS  OF  MULTJ -CORRECTION 

Data  2D- 1  (i)  Pulse  Ses 

(ii)  Process  and  Measurement  Noise 
(ili)  With  Accel.  Mess. 


PARAMETER 

r - 

TRUE 

VALUE 

EQUATIONS 

OF 

EXTENDED 

KALMAN 

MULTI -CORRECTION  * 

(TWO  ADDITIONAL  CORRECTIONS) 

MOTION 

F1 

Fj(2) 

F10<2> 

'  r 

28.  S 

-37.28 

27.259 

23.415 

106.43 

u 

-.176 

1.126 

.11753 

.  1909 

-1.254 

1 

-.00647 

-.00247 

-.00278 

.00317 

M  , 

1 

i 

-.100 

.610 

-.09351 

-.0451 

-.833 

i 

V 

9 

-.00517 

-.0102 

-.00438 

- .0051 

.00249 

-.497 

-1.256 

-.85188 

-.673 

-3.01 

y  _ 

.003155 

>> 

■/  ■ 

■55 

-41.3 

-33.287 

-35.9 

25.79 

y . 

.  0669 

.521 

.4598 

.484 

.0272 

| 

- 1  ~ 

18.3 

-18.88 

-5.671 

-9.36 

56.25 

6 

u 

-.0917 

.4752 

.2408 

.328 

-.626 

yl\ 

-.0005 

-.0025 

-.0015 

-.0019 

.0015 

V 

n 

i 

.221 

.689 

.447 

.516 

-.088 

V 

i 

-.00159 

i 

-.0052 

-.0032 

-.0039 

.0044 

■  1 

| 

i 

-•778 

t _  .  .  j 

KB&m 

-3.72 

-36.9 

H 

I 

OO 

o 

.0463 

.314 

■/  ~ 

-52.2 

il.71 

2.514 

2.819 

-11.99 

*0 

u 

.910 

!  .477 

.6301 

.65 

.9295 

-.007 

-.0064 

-.007 

-.0072 

-.0089 

rr 

i 

-.294 

-.5119 

-.6462 

-.6221 

-.673 

*  hf 

\y. 

i 

-.00287 

.00065 

.00032 

.00011 

.00068 

|i 

-.551 

-150.6 

-99.59 

-105.4 

-82.16 

.0167 

1.19 

.812 

.  863 

.7286 

‘Smoothed  panmeter  estimates  are  approximately  the  same. 


148 


stage 


Variance  Comparison  [P  (0)]  For  Diff*  rent  Start  Up  Procedures 
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*  Perturbed,  Radians 

**  Note  that  the  term  &h/  dp  was  neglected  in  Eq.  (3. 19) 
when  the  acceleration  measurements  were  used. 


TABLE  6-6b 

Parameter  Estimates  Employing  Different  Start-Up  Procedures 
and  an  Improved  Final  Variance  Computation 
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Variances  from  CR  lower  bound  were  multiplied  by  a  {actor  of  20. 
Filtered  parameter  estimates  are  approximately  the  same. 


TABLE  6-7 


Sensitivity  of  Parameter  Estimates 
to  Variations  In  Q 


Data:  3D-1 


Parameter 

T rue  Value 
-  Perturbed 
(deg) 

Initial 

Parameter 

Parameter  Estimates 
Locally  Iterated  Filter 

Pn  -  Start-Up  <• 

True 

R  *  O 

True  R 

4  Q 

"a 

0.  0 

-. 5202 

-.2042 

-.225 

Al*a 

-2.  06 

-. 6683 

-1 . 724 

-1.67 

AV 

-.369 

.5153 

-.  1774 

-. 1276 

M ' 

f 

-5.0 

-4. 368 

-5.098 

-5. 086 

M. 

S 

28.  65 

23.  39 

28.64 

28.49 

X 0 

.2861 

.  2907 

.  346 

.  352 

\ 

1.9 

-.  0566 

-.  1547 

-. 1548 

*ur 

- . 0675 

.  0489 

-.0438 

-.0414 

Kr 

3.0 

2.  826 

3.048 

3.053 

2. 

32. 199 

-33.01 

-33.03 

-33.03 

Z. 

-.180 

.0257 

125 

-.0447 

-.413 

-.  3290 

-.495 

-.427 

V 

.  90 

-1.011 

-.524 

-.5397 

*  Parameter  Variances  from  CR  lower  bound 
multiplied  equally  by  20 


152 


SEC  i  ION  VII 


APPLICATION  OF  ADVANCED  TECHNIQUES  TO  EXPERIMENTAL  DATA 

7.  1  Application  to  Princetor  Data 

The  Princeton  Dynamic  Model  Track  (PDMT)  of  Princeton  University 
is  a  facility  designed  expressly  for  the  dynamic  testing  of  scaled,  powered 
V/STOL  models  in  and  near  hovering  flight.  The  design  of  the  test  apparatus 
is  such  that  the  data  generated  should  not  be  directly  interpreted  via  conven¬ 
tional  airplane /helicopter  rigid  body  equations  of  motion;  modifications  must 
be  incorporated  in  the  equations  to  account  for  the  apparatus.  In  order  to 
ensure  a  familiarity  with  the  differences  between  PDMT  test  data  and  full- 
scale  flight  data,  we  shall  first  review  briefly  the  test  apparatus  at  the 
PDMT  and  the  type  of  data  that  this  generates.  We  will  then  discuss  the 
modifications  of  the  identification  programs  necessary  to  analyse  the  PDMT 
data.  Finally,  ihe  analysis  of  the  data  will  be  presented. 

7. 1.  1  Test  Apparatus  and  Coordinate  Transformation 

A  full  description  of  the  PDMT  is  given  in  Reference  59;  for  our 
purposes,  a  summary  will  suffice.  The  PDMT  consists  of  a  750-foot 
monorail  track  enclosed  within  a  30-foot  by  30-foot  building.  A  servo-driven 
carriage  rides  this  track;  for  dynamic  testing  in  the  plane  of  symmetry 
(longitudinal  degrees  of  freedom),  the  carriage  incorporates  a  boom  which 
allows  ±  5  feet  of  vertical  motion  relative  to  the  track.  A  powered, 
dynamically  scaled  model  is  attached  to  the  boom  by  horizontal  and  vertical 
error  links;  relative  motion  of  the  model  with  respect  to  the  boom  is  mea¬ 
sured  by  the  links  and  used  to  command  the  carriage  to  follow  horizontal 
motion,  and  the  vertical  boom  to  follow  vertical  motion.  The  model  is 
attached  to  the  error  links  through  a  pivot  about  which  it  is  free  to  rotate 
in  the  plane  of  symmetry.  The  error-link  commands,  therefore,  allow  the 
pivot  point  to  move  such  that  the  model  flies  "free"  --  its  motion  is  not 
mechanically  constrained.  Linear  velocities  and  accelerations,  parallel 
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and  perpendicular  to  the  track,  are  measured,  as  are  angular  position,  rate, 
and  acceleration  at  the  pivot  point.  The  measured  quantities  are  telemetered 
and  recorded  in  analog  form;  an  analog-digital  converter  then  records  them 
in  digital  form  (along  with  some  scaling),  and  CAL  received  them  in  this 
form. 


The  CAL  computer  programs  for  V/STOL  identification  have  been 
written  to  be  compatible  with  flight  test  data,  and  the  state  variables  are 
therefore  written  with  respect  to  a  body  axis  system  with  the  origin  at  the 
center  of  gravity.  Since  the  PDMT  data  are  measured  with  respect  to  a 
space-fixed,  or  inertial,  axis  system  at  the  pivot,  they  must  be  transformed 
to  body  axis  variables. 


The  transformation  is  a  straightforward  translation  and  rotation 
(see  Figure  7- I),  and  the  results  are*. 


es  '-1  °s 

ag  -  uscos  99- ur^  $inds  +  qi. 

ur8  =  u^cos  9S  +  «-s  sin  e.s-  #s  ( r) 

*B  = 

Ug  =  cos  es  -  ars  sin  Qs  -  *5  ^  sin  *?s  -  Cos  9S  *  Z^ 
uj-g  =  ur5  cos  0S  *  as  sin  es-u£,<is  sin  9S  *  vf?scos0s  -  (.V^-  r) 

9a  =  is 


where  the  subscripts  S  and  B  are  for  inertial  and  body  axis  systems 
respectively,  and  2^  and  [XCq- *')  denote  the  vertical  and  horizontal 
distances,  respectively,  between  the  pivot  point  and  c.  g.  (See 
Figure  7-  1) . 
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7,  1.  2  Equations  of  Motion  for  FDMT  Quad  Duct  Test  Model 

In  addition  to  the  data  transformations  necessary  to  adapt  the  PDMT 
measurements  to  CAL  identification  programs,  the  equations  of  motion 
employed  in  these  programs  must  themselves  be  modified  to  account  for  a 
difference  between  *he  model  dynamics  and  those  from  a  full- scale  flight 
test  which  arises  from  the  effect  of  the  error  linkages.  A  schematic  sketch 
is  shown  in  Figure  7-2;  from  this  may  be  seen  the  essential  fact  that  a 
dynamic  test  on  the  PDMT  involves  three  masses: 

(1)  The  quad  model  itself  (A f )  which  is  free  to  rotate  about 
the  pivot  and  translate  horizontally  and  vertically. 

(2)  The  vertical  error  link  (  My  ),  which  may  translate 
horizontally  and  vertically  in  the  inertial  reference 
frame  but  which  does  not  rotate. 

(3)  The  horizontal  error  link  ( Mf,  ),  which  may  translate 
only  horizontally  in  the  inertial  reference  frame,  and 
which  does  not  rotate. 

As  we  have  explained,  these  links  provide  the  position  error  signals  of  the 
model  motion,  and  are  carried  by  the  model;  although  aerodynamic  forces 
on  them  may  generally  be  neglected,  their  ine:/tial  effects  should  be  in¬ 
cluded.  In  essence,  the  "reference  masses"  which  are  accelerated  by 
external  forces  are  different  in  horizontal,  vertical,  and  rotational  motions: 

Horizontal:  M  +  My  * 

Vertical:  M  *  Mv 

Rotational:  M  (or  ICg) 


The  full  development  of  of  the  equations  of  motion,  under  only  the 
assumption  that  c.g.  position  and  Ic<|  may  be  considered  constant,  is  given 
in  Appendix  L;  the  resulting,  nonlinear  equations,  in  a  body  axis  system, 
are  summarized  below; 
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where: 


v. 

i- 


M+Mv 

6  -  - - 

M  *  My  +  Mh 

Mv 


%  - 


Mh 


-1-o 


For  the  quad  model,  tiie  values  of  the  above  parameters  are: 

M  =  47.4  lb  <5r  =  0.90 

My  =  4.  1  lb  A  =  0.072 

Mh  =  5. 6  lb  %  -  0.  1 

Theae  equations  for  the  model  are  considerably  more  complex  than 
those  for  the  full-scale  machine.  The  effect  of  the  error  links  and  the  c.g. 
offset  have  introduced  additional  functions  of  the  usual  state  variables  into 
the  equations,  and  have  also  added  functions  of  ^  .  Although  these  changes 

could  be  implemented  into  the  CAL  computer  programs,  it  would  be  pre¬ 
ferable  to  employ  an  existing  program.  With  this  in  mind,  some  simplifications 
are  made.  Since  the  c.g.  offset,  l  =  0,  at  the  midpoint  of  the  duct  angle 
range  (  %  =  60*),  it  is  reasonable  to  consider  the  largest  possible  value  these 
terms  could  have  and  compare  their  orders  of  magnitude  with  the  other  terms 
in  the  equation.  Based  on  known  geometric  characteristics  of  the  PDMT  quad 
model  (References  60  and  61),  the  maximum  possible  values  of  c.g.  offset 
may  be  found  to  be: 


=  0.03  feet 
=  0.0  75  feet 


157 


(It  should  be  noted  that  these  values  occur  at  different  values  of  X  ,  but  for 
order-of-magnitude  estimations  we  use  the  maximum  values  regardless  of 
this  discrepancy.)  Using  these  values,  and  limiting  pitch  angle  to 
0*  <  e  <  30°,  it  was  found  that  the  maximum  values  of  the  coupling  terms 
in  the  force  equations  are: 

Horizontal  force:  q  term  is  order  of  0.06  ft/sec4 

q2  term  is  order  of  0.02  ft/sec4 
Vertical  force:  q  term  is  order  of  0.04  ft/ sec2 

cf  term  is  order  of  0.03  ft/sec4 

Although  these  approximate  values  were  obtained  using  model-scale  values, 
iheir  dimensions  are  linear  acceleration;  they  may  therefore  be  compared 
directly  to  full-scale  linear  accelerations  (see  Reference  60),  and  can  be 
seen  to  be  negligible. 

Also,  in  the  moment  equation,  the  center -of- gravity  offset  terms 
multiplying  q  appear  to  the  second  power  and  may  be  neglected,  as  they  are 
small  compared  to  J  ;  similarly  the  q2  term  is  multiplied  by  offset  terms 
to  the  second  power  and  may  be  neglected.  The  terms  involving  linear 
accelerations,  however,  may  be  significant  compared  to  1 ^  q  ,  and  must 
be  retained. 


The  approximate  equations  are  therefore  (utilizing  the  simplification 
resuiting  from  the  fact  that  ^  ^ )• 
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Subsequently,  more  simplifications  were  made  when  the  PDMT 
Quad  Model  test  data  were  made  available  to  CAL  (Reference  611.  It  iuas 
found  that  for  the  tests  conducted,  which  were  fixed-operating  point  tests 
at  the  duct  incidence  of  45  deg,  60  deg,  and  ?5  deg,  the  actual  values  of  the 
c.  g.  offset  were  as  follows: 


Duct  Incidence  deg 

45 

60 

Ts 

c.  g.  offset 

Horizontal 

Vr 

0.0052  ft 

0 

-0.0111  ft 

[ 

_ _ 

Vertical 

7 

0.0071  ft 

0 

- - 

-0.0005  ft 

Notice  that  the  values  of  the  actual  c.  g.  offset  were  negligibly  small  as  com¬ 
pared  to  the  maximum  possible  values  in  the  preceding  order-of-magnitude 
estimations.  Also,  it  was  found  that,  by  examining  the  test  data,  the  pitch 
attitude  excursion  was  well  within  ±  15*.  With  these  observations. 

Equations  (7.  3)  were  further  simplified  to  (7.4) 


' *6*  *  9°°*  0  *  X**rs8 ~ 
«r3-  *a9  ~  6  3  Z*€roa 

k  *  Mtovg 


(t-  s)  sin  9  oo s  9  £&erv8 


(7.4) 


for  the  analysis  of  these  test  data.  Comparing  (7.4)  to  our  nonlinear  equa¬ 
tions  of  motion  for  the  full-scale  X-22A,  we  see  that  there  is  an  extra  term 
sin  9  which  was  regarded  as  a  process  noise  later  in  the 

parameter  identification  process. 

In  Appendix  L,  a  linearization  of  the  complete  nonlinear  equations 
(7.  2)  was  also  performed  with  the  assumption  that  a  small  perturbation  was 
valid  for  fixed-duct  tests.  The  resulting  linearized  Equations  (L.  14)  and 
(L.  15)  are  extremely  complicated.  However,  after  evaluation  of  the  terms 
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in  these  equations  using  the  quad  duct  mass  parametex'3,  s  -  0.90»  /*  -0.73, 
|  =  0.  I,  moment  of  inertia  Ieg  =  2.  30  slug-ft2,  and  the  actual  values  of 
c.g.  offset,  along  with  the  usual  assumption  that  ~  Zur  ~  ^ ur  =0» 
equation  (L.  15)  may  be  simplified  to 
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where  the  variables  are  perturbation  values,  and  the  body  derivatives  X#- 
(l  *  u.,ur,E,  Ses)  are  related  to  X;  »  2;  »  ky 


Zi 


Wz 
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(7.6) 


where  f j  ,  j  =  1,  2,  6  are  functions  of  the  trim  pitch  attitude  Q0  : 


r  =  sinz90  *C.9cs5Z  ,  =-  0./  sm0o^sOo  ,  ^  =  *  0.9 


The  values  of  these  functions  for  the  tested  conditions  a:*e  listed  in  the 
following  table. 


ft-deg 

45 

60 

J5 

0o-deg 

_S 

— - 

0 

5 

_5 

0 

5 

-  5 

0 

5 

A 

.9 

,9004 

.  9004 

0.9 

.9004 

.9004 

0.9 

0.9004 

i  ? 

!  ** 

» 

w 

0 

. 00868 

-.00868 

0 

.00868 

-.00868 

0 

.00868 

l_L_ 

0  -§ 
r-  w 

1.0 

.99884 

. 99884 

1.0 

.99884 

0.99884 

1.0 

. 99884 

One  may  proceed  directly  to  linearize  the  simplified  nonlinear 
equations  of  motion  (7*4).  The  resulting  linear  equations  are  slightly  simpler 
as  shown  in  equation  (7.7). 
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7.  1.  3  Conversion  of  Princeton  Test  Data  to  Identification  Computer 
Program  Data  Format 


The  PDMT  test  data  were  received  by  CAL  from  Princeton  University 
in  April,  1970.  The  data  include  the  digital  tapes,  the  analog  traces,  the 
test  conditions,  and  the  data  conversion  factors.  There  are  29  runs  at  a 
duct  incidence  of  75*;  54  runs  at  60*  and  44  runs  at  45*.  As  described 
earlier,  all  the  data  were  measured  with  respect  to  the  space-fixed  axis 
system.  Data  measured  were  &s  ,  $$  ,  ,  d8  ,  , 

7}^  ,  J£s  ,  and  3  .  The  inputs  used  in  these  runs  were  longitudinal  stick 
deflectiou  with  or  without  collective  inputs.  The  longitudinal  stick  inputs 
were  doublets  with  periods  of  two  seconds;  all  the  collective  inputs  were 
step  inputs.  Various  levels  of  rate  feedback,  depending  on  duct  incidence, 
were  used  in  all  the  test  runs.  The  differential  elevon  deflections,  ASf  , 
were  linearly  proportional  to  the  differential  collection  commands  AB  with 
the  following  mixing  ratios: 


%  *•  deg 

75 

60 

45 

Af,  deg/ 
W”  deg 

_ 

1.0 

2.0 

The  pitch  acceleration  data  were  quite  noisy  and  very  inconsistent  with  pitch 
rate  measurements;  the  data  were  taken  using  two  displaced  linear 
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accelerometers.  Apparently,  the  pitch  accelerometer  originally  installed 
was  not  up  to  specifications.  More  detailed  descriptions  of  the  data  are 
given  in  Reference  61. 


Using  the  conversion  factors  supplied  by  PDMT,  the  nine-track 
digital  data  of  Princeton  were  transcribed  to  a  CAL  tape  in  their  correct 
dimensional  form  (e.  g. ,  ft/sec,  deg/seca,  etc.).  These  data  were  further 
transformed  from  the  PDMT  measurement  axis  system  to  a  body-fixed  axis 
system  using  equation  (7.  1).  Because  the  linear  accelerometers  were 
mounted  with  a  slight  inclination  to  the  reference  body  axis  system  of  the 
model,  necessary  corrections  on  the  measured  and  n  were  made. 
However,  no  transformations  were  required  for  Ses  and  B  . 


Since  the  data  were  in  model  scale,  the  stability  and  control  deriv¬ 
atives  identified  from  these  data  will,  of  course,  be  in  model  scale.  To 
convert  the  values  of  the  model-scale  derivatives  to  those  of  full-scale 
derivatives,  the  conversion  factors  can  be  derived  from  Reference  60.  The 
results  are  listed  in  Table  7-3.  This,  then,  is  the  final  conversion:  the 
stability  and  control  derivatives  are  now  full-scale,  the  body-axis  values, 
and  may  be  compared  to  other  available  data.  We  shall  next  discuss  the 
results  af  identification  runs  on  the  PDMT  data. 


7.  1.4  Identification  Results  Using  Princeton  Data 

The  Princeton  data  were  initially  analyzed  with  the  linear  Kalman 
filter  program  without  using  acceleration  measurements,  since  the  nonlinear 
computer  program  had  not  reached  the  final  form  described  in  Section  V. 

Data  analysis  was  begun  with  ^  =  75®  data.  Six  runs  at  &  =  75*  were  chosen 
for  consideration;  they  are  listed  below  with  heir  inputs: 
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Run  No. 

$e$  doublet 
input 

S  step 
input 

ft 

degrees 

U, 

0 

fps 

55 

.5 

.  3 

-1.215 

17.26 

58 

-.5 

.  3 

-1.526 

17.33 

68 

-.5 

.  15 

5.968 

9.935 

71 

.5 

.  3 

6.  Ill 

9.82 

76 

.  5 

.6 

-5.57 

21.  15 

79 

.25 

0 

-6. 147 

21.44 

The  X  =  75"  data  were  chosen  for  initial  identification  attempts  because 
the  length  of  data  runs  is  longest  at  this  flight  condition.  Because  of  the 
low  trim  velocity  at  this  flight  condition,  the  small  perturbation  assumption 
on  velocity  is  not  valid,  as  we  shall  see  later.  Nonetheless,  these  data  were 
analyzed  using  the  linear  equations  in  order  to  check  the  computer  results 
against  available  PDMT  results,  which  were  generally  derived  using  linearized 
equations. 

A  sample  of  early  identification  results  is  shown  in  Tables  7-.’.  and 
7-2.  Table  7-1  shows  the  results  of  a  linear  Kalman  run  on  data  No.  55 
using  the  equations -of- motion  method  to  obtain  initial  estimates.  The  mea¬ 
surement  noise  statistics  were  estimated  from  the  data  and  are  shown  in  the 
following  table. 


Measurement  Noise  at  /U  =75  Deg 


Motion 

Variables 

Measurement  NoUc 
Standard  Deviation 

4  ~  deg/sec 

.25 

Q  ~  deg 

.  15 

u>  -  deg 

.  10 

ur  -  de8 

.  15 
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The  transient  response  computed  using  the  parameters  identified  in 
Table  7-1  matches  very  wall  with  the  data  as  shown  in  Figure  7-4.  Table 
7-2  shows  the  results  of  using  the  same  data  (No.  55)  with  the  initial  esti¬ 
mates  obtained  by  scaling  down  parameter  values  obtained  from  the  global 
aerodynamic  program  (Reference  1).  However,  as  shown  in  Figure  7-5,  the 
response  computed  from  the  global  values  matches  very  poorly  with  the  data, 
although  the  time  histories  computed  from  the  parameters  identified  using 
the  linear  Kalman  program  again  match  well  with  the  data. 

From  Tables  7-1  and  7-2,  it  is  seen  that  the  parameters  identified 
using  the  two  different  sets  of  initial  estimates  are  considerably  different. 

This  may  be  partly  attributable  to  the  following  reasons: 

(i)  Initial  covariance  matrix.  The  variances  of  the  param¬ 
eter  estimates  computed  from  the  equations -of- motion 
program  were  used  for  the  Kalman  program  initialization 
for  both  sets  of  initial  estimates.  As  was  discussed  in 
Section  V,  these  variances  are  too  small  to  indicate  the 
dispersion  of  the  estimation  error.  In  a  sense,  the 
early  versions  of  the  Kalman  filter  may  be  regarded 

as  attaching  a  "confidence  1  ;vel"  to  the  initial  estimate 
of  a  parameter  based  on  its  variance.  If  the  variance 
Is  small,  this  indicates  a  high  confidence  level,  and 
the  filter  will  not  adjust  the  parameter  value  much  from 
its  initial  estimate.  Tables  7-1  and  7-2  give  evidence 
that  this  was  the  case. 

(ii)  Acceleration  measurements.  Acceleration  measure¬ 
ments  were  not  used  in  these  runs.  It  was  discussed 

in  Section  VI  that  the  acceleration  measurements  contain 
additional  information.  Use  of  this  additional  infor¬ 
mation  should  further  alleviate  the  nonuniqueness  prob¬ 
lem. 


Unfortunately,  as  described  earlier,  neither  the  improved  start-up  procedure 
nor  the  use  of  accelt  ration  measurements  were  included  in  the  linear  Kalman 
program.  Thus,  the  results  of  the  early  applications  of  the  technique  to  the 
Princeton  data  were  not  conclusive. 

Several  ancillary  results,  however,  were  indicated  by  this  applica¬ 
tion.  For  example,  from  Figure  7-4,  it  is  clear  that  the  global  parameters 
do  not  represent  well  the  model  dynamics.  Furthermore,  it  was  found  that 
the  linearized  equations  (7-4)  poorly  represent  the  dynamics  of  the  PDMT 
model  at  %  -  75*.  Indeed,  a  sample  calculation  using  run  No.  55  revealed 
that  the  neglected  kinematic  terms  in  the  linearization  of  the  X  and  Z 
equations,  and  ,  were  the  same  order  of  magnitude  as  Xur&uJ', 

and  An  ,  ,  where  the  values  of  the  derivatives  X^  ,  Xu  ,  ?.u  , 

were  taken  from  global  or  available  PDMT  values  as  shown  in  Teble  7-1. 
Clearly  then,  the  linearized  equations  (7.4)  are  inadequate  to  represent  the 
*  =  75*  data. 

We  also  found  that  the  trim  definition  of  the  PDMT  model  is  not 
entirely  satisfactory  for  identification  purposes.  Initially,  the  initial  data 
point  was  used  as  the  trim  value,  a  procedure  which  may  lead  to  inconsistent 
trim  values.  In  addition,  the  addition  of  a  collective  input  at  the  X  =  75* 
cases  frequently  was  necessary  to  maintain  level  flight  path  angle  (rather 
than  the  expected  climb),  a  fact  which  might  indicate  ;.r iproper  initial  trim. 
The  use  of  incorrect  trim  values  in  the  equations  of  motion  can  lead  to 
erroneous  results. 

The  trim  anomaly  can  be  avoided  if  one  performs  the  linearization 
of  the  nonlinear  equations  about  some  accelerated  reference  conditions 
(rather  than  trim  conditions).  If  this  is  done,  we  have,  in  lieu  of  equation 
(7.  5),  the  following  linearized  equations: 
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where  the  variables  are  perturbation  values  from  their  reference  values  u-%  , 
UTg  »  ty/c  »  Qq  >  »  M's  •  If  is  chosen  to  be  zero,  then  %D  > 

and  yn'0  become  constants.  This  equation,  with  the  primes  removed,  was 
later  used  in  the  initial  application  of  the  techniques  to  the  X-22A  flight  test 
data.  Since  in  our  nonlinear  program  the  reference  values  are  used  in  rep¬ 
resenting  the  aerodynamic  terms  as  described  in  Section  II,  the  trim  prob¬ 
lem  does  not  exist. 

We  now  present  the  results  of  data  analysis  using  the  nonlinear 
identification  program.  Data  analyzed  are  cases  at  duct  incidences  of  45* 
and  75*.  The  flight  conditions,  inputs,  and  reference  values  of  these  cases 
are  shown  in  Table  7-4  and  the  noise  levels  of  these  data  are  shown  in 
Table  5 . 


It  is  to  be  recalled  that,  due  to  the  iner'.ia  effects  of  the  error 
’  nkages,  the  general  nonlinear  equations  of  motion  derived  by  CAL.  for  the 
Princeton  dynamic  model  are  very  complicated  as  shown  in  equation  (7.2). 
Further  simplifications  were  subsequently  made  using  the  actual  data  fur¬ 
nished  by  Princeton.  Equation  (7.4)  shows  the  simplified  nonlinear  equa¬ 
tions  of  motion.  It  is  seen  that  the  X-equation  has  an  extra  term  which  is 
not  present  in  the  equations  of  motion  for  the  full-scale  X-22  aircraft. 
Without  modiiying  the  computer  program,  this  term  was  treated  as  a 
modeling  error  which  can  be  considered  as  process  noise  (  )  as  shown 

In  Table  7-5. 
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The  results  of  the  computer  i'ui'io  aic  shown  in  Tables 


7  k  7-7 


7-8.  The  transient  response  matching  for  the  four  runs  on  Table  7-6  is 
shewn  in  Figures  7-6  through  7-9.  It  is  seen  from  these  figures  that  the 
parameters  identified  using  acceleration  measurements  and  using  modeling 
error  simulation  result  in  a  better  match  to  the  data.  Figure  7-10  shows 
the  time  histories  computed  using  the  parameters  identified  from  No.  154 
(the  parameter  set  in  the  column  next  to  the  last  on  Table  7-6)  and  the  input 
of  No.  157;  the  data  plotted  are  those  of  No.  157;  and  the  responses  com¬ 
puted  from  the  initial  estimates  of  No.  157  are  also  shown  in  this  figure. 
Table  7-9  shows  a  comparison  of  the  effects  of  linearized  and  nonlinear 
kinematic  coupling  for  run  No.  55,  and  Figure  7-11  shows  the  transient 
response  matching  for  the  parameter  set  shown  in  the  last  column  of  Table 
7-9.  Notice  that  the  data  length  used  in  the  nonlinear  runs  for  No.  55  is 
10  seconds  instead  of  the  total  length  of  approximately  14  seconds  used  in  the 
linear  Kalman  runs  (see  Figure  7-4).  From  Table  7-9,  it  is  seen  that  the 
most  significant  change  in  the  parameters  identified  appears  to  be  in  the 
control  derivatives. 


From  these  computer  runs,  it  may  be  seen  that  the  identified  deriv¬ 
atives  in  the  pitching  moment  equation  are  fairly  consistent.  In  fact,  a 
sensitivity  computation  shows  that  the  inputs  for  these  runs  analyzed 
(doublet  in  SE5  and  step  in  B  )  is  adequate  for  the  identification  of  pitching 
moment  derivatives;  but  the  inputs  do  not  give  sufficient  sensitivity  for  X  $  , 
Xj  ,  .  It  appears  that  a  collective  input  other  than  a  simple  step 

is  desirable.  Thus,  it  is  recommended  that  the  experimental  input  design 
method  discussed  in  Appendix  F,  which  uses  sensitivity  as  the  criterion  to 
determine  the  input,  should  be.  employed  prior  to  any  future  PDMT  test  to 
determine  an  input  which  would  enable  the  extraction  of  better  quality  param¬ 
eter  estimates. 


As  we  mentioned  earlier,  the  angular  acceleration  measurements 
are  inconsistent  with  the  pitch  rate  measurements.  Clearly,  the  present 
method  used  at  the  PDMT  of  using  two  linear  accelerometers  to  replace  the 
sensor  is  inadequate  for  the  identification  requirement.  Also,  the  missing 
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terms  in  the  X  force  equation  due  to  the  error  linkage  inertia  coupling  were 
compensated  by  considering  it  as  process  noise;  however,  since  it  is  a 
deterministic  function,  the  missing  terms  in  the  X  force  equation  should  be 
programmed  into  the  computer  equations  in  the  f  ture, 

7.2  Application  to  X-22A  Flight  Data 

Application  of  the  identification  technique  to  actual  flight  test  data 
obtained  from  the  Phase  II  Military  Preliminary  Evaluation  (MPE  II)  of  the 
X-22A  variable  stability  aircraft  is  presented  in  this  section  (Reference  58). 
Identification  results  for  two  cases  each  at  fixed  duct  incidences  of  A  -  30* 
and  1  =  45*  are  given,  employing  both  the  linear  version  (equation  D.  2)  of 
the  extended  Kalman  filter  and  the  nonlinear  locally  iterated  filter  (5.  1  and 
5.2).  Due  to  the  limited  availability  of  transition  data,  results  are  presented 
for  only  one  slow  transition. 

7.  2.  1  Data  Selection  and  Digitization 

The  MPE  II  of  the  X-22A  aircraft  consisted  of  eleven  test  flights, 
labelled  2F195  through  2F205,  conducted  from  31  March  to  1 1  April  1969  for 
the  purpose  cf  "qualitatively"  evaluating  the  state  of  development  and  potential 
of  the  X-22A  VSS  (Reference  58).  Although  the  evaluation  was  qualitative  in 
nature,  data  were  recorded  in  flight  on  a  50-channel  oscillograph.  These 
flight  data  were  the  only  available  data  for  the  X-22A  for  the  purpose  of 
parameter  identification  during  this  project.  Consequently,  each  flight  plan, 
fiight  log  and  oscillograph  record  were  carefully  scrutinized  to  obtain  flight 
data  which  could  possibly  be  used  in  the  identification  of  stability  and  control 

derivatives  »n  the  longitudinal  plane  at  fixed  duct  incidence  and  slow 

•  • 

(  %  »  ±1.5  deg/sec)  and  fast  (  &  a  ±4  deg/sec)  transition.  The  main  criteria 
used  for  selection  were; 

(a)  little  lateral-directional  motion. 

(b)  large  longitudinal  maneuvers  (large  signal  to  noise  ratio), 
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(c)  variable  stability  system  (VSS)  in  operation 
{if  possible),  and 

(d)  equivalent  flight  conditions  (weight,  altitude,  etc.). 

All  four  criteria  were  considered  very  important  from  the  stand¬ 
point  of  identification,  as  well  as,  of  course,  accurate  measurements. 

VSS  operation  was  considered  important  because  the  equations  of  motion 
were  written  considering  the  iongitudinal  stick  position,  as  a  control 

input  rather  than  the  individual  elevons  and  blades.  Since  the  feedforward 
system  is  in  operation  in  the  VSS  mode,  control  system  nonlinearities, 
which  are  not  modeled,  are  therefore  reduced.  Thus,  when  in  the  VSS  mi  ie, 
the  measurements  at  the  actual  longitudinal  stick  position  can  directly 

be  used  for  identification. 

All  the  required  measurement  sources,  with  the  exception  of  ur , 
were  available  on  the  oscillograph  traces.  Since  is  a  function  of  uT  , 
the  ay  (alpha  vane)  measurements  were  used  in  place  of  ur  .  This,  of 
course,  precluded  data  selection  at  low  speed  operation.  Unfortunately, 
not  being  able  io  design  the  experiments  (the  flight  tests)  a  priori  for  our 
specific  purpose,  data  could  not  be  found  which  simultaneously  satisfied 
all  four  criteria.  The  best  data  available  were  selected  for  data  reduction. 

Once  a  flight  record  was  selected,  the  measured  responses  were 
manually  digitized  at  a  sampling  frequency  high  enough  to  avoid  consistent 
bias  errors.  However,  the  recorder  speed  allowed  a  minimum  sampling 
time  of  .  1  seconds.  Without  channel  filters,  the  T!%  ,  ^  and  q  traces 
were  so  corrupted  with  high  frequency  noise  (especially  the  v%  and 
traces)  that  it  was  necessary  to  manually  fair  ("smooth")  a  line  through  these 
measurements  prior  to  sampling.  Consequently,  the  and  v ■  measure¬ 
ment  accuracy  is  very  questionable.  Since  .  1  seconds  is  slightly  coarse, 
the  sample  interval  was  reduced  to  .05  seconds  by  linear  interpolation  of 
the  digitized  data.  Fairing  of  all  other  measurements  was  done  where  nec¬ 
essary.  In  general,  in  addition  to  the  poor  quality  of  the  oscillograph  re¬ 
cordings,  it  was  found  the  data  had  relatively  low  signai-to-noise  ratio  and 
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consequently  were  not  very  desirable  for  parameter  identification. 

5  our  fixed-duct  incidence  cases  were  selected  and  digitized  from 
the  oscillograph  records.  The  two  cases  at  X  =  30*  are  2F197  and  2F203 
and  those  at  X  =  45*  are  2F195  and  2F198.  Time -in -flight  and  aircraft 
operating  points  are  given  in  Table  7-10.  Motion  variables  measured  were 
9  >  &  ,  u.  ,  av  ,  7tv  ,  ft  and  .  The  control  input,  ,  was  mea¬ 
sured  at  the  R.H.  pitch  stick,  and,  in  actuality,  sin  9  is  the  measurement 
source  and  not  Q  .  However,  due  to  the  small  perturbation  in  Q,  sin0»£. 

Three  equivalent  cases  for  slow  accelerated  transition  (i  =  -1.5 
deg/sec)  were  also  selected  from  the  MPE  II  data.  Time-in-flight  and 
operating  points  for  these  cases  are  given  in  Table  7-10.  The  case  from 
2F197  was  manually  digitized  from  the  oscillograph  recorder  and  the  other 
two  were  used  to  Define  the  reference  trajectories  necessary  for  the  param¬ 
eter  identification  of  the  first  ca  >e.  However,  no  useful  high  rate  transition 
cases  could  be  found. 

Motion  variables  measured  were  the  same  as  those  for  the  fixed- 
duct  incidence  cases.  However,  during  transition,  the  X  -22A  was  in  the 
fly-by-wire  (FBW)  mode,  and  thus  the  feedforward  loop  was  not  operational. 
Consequently,  in  order  to  circumvent  control  syster .  nonlinearities,  the 
individual  elevon  and  propeller  pitch  settings  were  digitized  and  equivalent 
longitudinal  stick  positions  were  found  using  the  static  calibration  data  from 
References  62,  63,  and  64.  Duct  angle,  X  ,  and  collective  pitch  stick, 
inputs  were  also  digitized  from  the  recorded  traces  of  these  variables. 

7.  2.  2  Selection  of  Noise  Levels 

The  measurement  noise  and  process  noise  levels  estimated  from 
the  flight  records  are  given  in  Table  7-11.  Since  the  effects  of  process  noise 
can  be  observed  in  the  acceleration  measurements,  two  sets  of  measure¬ 
ment  noise  levels  are  given  for  the  acceleration  measurements,  depending 
on  whether  process  noise  is  assumed  present  or  not. 
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Although  all  high  frequency  noise  was  removed  by  manually  fairing 
each  response  prior  to  discretization  as  explained  above,  the  standard 
deviations  of  the  measurement  noise  were  taken  as  the  peak-to-peak  noise 
level  present  divided  by  4.  These  values  were  then  checked  to  make  sure 
they  agreed  with  the  absolute  rrns  accuracy  v/hich  could  be  expected  from 
the  respective  sensor  and  recording  system,  including  the  "human  tele- 
reading"  of  the  responses.  In  this  way,  the  filter  will  be  able  to  properly 
interpret  the  accuracy  of  the  data  it  receives. 

The  selection  of  Q  (the  process  noise  covariance  matrix)  from 
flight  test  dat-i  is  much  more  difficult.  Here,  process  noise  is  primarily 
construed  as  uncertainty  in  the  mathematical  model  or  unknown  forcing 
inputs.  With  this  interpretation,  it  is  obvious  that  the  process  noise  sta¬ 
tistics  are  nonstationary  with  nonzero  mean.  However,  the  process  noise 
is  characterized  as  a  stationary  random  process  with  zero-mean  in  the 
filter  model  Therefore,  some  means  of  a  priori  estimating  its  value  (on 
the  average)  must  be  used.  The  approach  taken  here  was  to  assume  model¬ 
ing  errors  in  the  aerodynamic  representation  of  the  aircraft.  Since  these 
errors  are  observable  in  the  acceleration  measurements,  e  for  the  process 
noise  were  defined  as  10%  of  the  sq.iare  root  of  the  average  power  in  the 
acceleration  measurements  --  called  the  rms  (root  mean  square)  value. 

For  example,  <y  for  was  calculated  as 


where  A /  is  the  number  of  data  points  and  is  the  acceleration  measure¬ 
ment  of  ^  at  the  point.  Since  is  always  approximately  1  g,  a  factor 
of  4%  was  used  instead  of  10%  for  this  measurement.  Results,  which  are 
approximately  representative  for  all  five  flight  records,  are  given  in 
Table  7-11. 


=s=  The  analog  oscillograph  records  are  manually  digitized  by 
employing  -z  Telereader. 
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It  should  be  noted  that,  when  process  noise  is  used  in  the  filter 

model,  the  noise  levels  in  the  #  ,  71  and  a  acceleration  measurements 

x  7 

are  reduced  accordingly.  In  the  results  presented  below,  the  process  noise 
{when  used)  was  assumed  to  enter  the  dynamics  through  a  sample  and  hold 
as  explained  in  Section  VI.  This  interpretation  is  not  exactly  correct  for 
flight  data,  since  the  dynamical  representation  of  the  aircraft  is  continuous. 

7.  2.  3  Results  at  Fixed-Duct  Incidence 

The  flight  conditions  and  reference  values  employed  for  all  four 
cases  at  fixed-duct  incidence  angle  are  given  in  Table  7-12.  Equivalent 
reference  values  were  selected  for  flights  at  equal  duct  incidence  for  ease 
in  comparing  the  parameter  estimates  obtained. 

F  rom  the  results  of  applying  the  technique  to  computer  generated 
data  3C-1  and  3D- 1  as  well  as  the  PDMT  data,  it  was  found  that,  for  the 
inputs  used  in  these  flight  tests,  the  X  and  Z  derivatives  were  relatively 
insensitive  ar.d  thetefore  difficult  to  identify,  although  '.he  sensitivity  of  the 
pitching  moment  derivatives  appears  to  be  adequate  for  good  parameter 
identification  of  the  M  derivatives.  In  all  identification  runs  in  this  section, 
the  initial  estimates  for  the  aircraft  states  (  $  ,  ,  U-a  and  )  were  chosen 

to  be  the  first  measured  data  point  and  the  variances  for  these  estimates 
(for  components  or  ^  )  were  the  measurement  noise  on  their  respective 
sensors.  Since  there  is  no  ur  sensor,  an  equivalent  noise  level  was  com¬ 
puted  for  this  signal,  using  first-order  approximations. 

Prior  to  the  development  of  the  locally-iterated  filter  employing 
the  nonlinear  model  for  the  X-22A,  preliminary  identification  results  were 
obtained  on  data  2F197  a.nd  2F203  (  %  =30")  using  the  linear  version  of  the 
extended  Kalman  filter  (linear  model,  equation  D.  2)  without  acceleration 
measurements.  Results  for  each  case  are  presented  in  Table  7-13.  Since 
the  linear  version  of  the  extended  Kaiman  filter  was  not  programmed  with 
an  oCy  measurement  source,  a  iV  measurement  was  obtained  by  calculating 
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Uf  from  the  tcv  ,  q  ,  and  u  measurements.  Similarly,  and  mea¬ 
surements  were  transferred  to  u-  and  u/"  for  use  in  the  equations -of- motion 
estimator.  The  filter  was  started  using  the  variances  (multiplied  equally  by 
a  factor  of  10)  from  the  equations -of- motion  estimator  and  systematically 
recycled  three  times  forward.  Process  noise  was  assumed  zero.  As  ex¬ 
plained  in  Section  7.  1,  X0  ,  Zg  and  Mq  were  used  to  eliminate  trim  uncer¬ 
tainties. 

The  results  for  these  cases  are  impressive.  Transient  response 
matching  to  measured  data  is  shown  in  Figure  7-12  and  7-13  for  2F  1 97  and 
2F203,  respectively.  Close  response  matching  to  the  state  measurements  is 
noted.  Clearly,  the  linearized  equations  characterize  the  X-22A  very  well 
for  thi3  case. 

Using  the  nonlinear  program  and  the  simple  version  o*  the  locally 
iterated  filter  (the  version  in  which  process  noise  is  assumed  zero,  i.e., 
in  (5.  1)  and  (5.  2)  set  Q  =  0),  identification  was  performed  on  2F197  and 
2F203  with  nonlinear  aerodynamics  (23  parameters)  and  linear  aerodynamics 
(13  parameters)  without  acceleration  measurements.  Results  are  given  in 
Tables  7-14  and  7-15. 

Because  of  the  small  airspeed  change  (a  maximum  speed  change  of 
5  or  6  fps)  in  both  cases,  the  correct  nonlinearities  of  the  derivatives  with 
respect  to  u  in  the  23-parameter  cases  were  not  expected;  however,  upon 
evaluating  these  derivatives  at  the  average  airspeed  of  138  fps,  the  two  23- 
parameter  cases  were  somewhat  consistent  with  their  corresponding  13- 
parameter  cases  as  shown  in  Table  7-16.  For  all  the  cases  run,  the  moment 
derivatives  appeared  to  be  fairly  consistent;  the  Z  and  the  X  derivatives 
did  not.  This  is  attributable  to  the  fact  that  the  aircraft  had  little  motion  in 
both  u.  and  ur  in  these  twro  cases.  Transient  response  matching  to  mea¬ 
sured  data  (Figure  6-14,  flight  2F197)  employing  23  and  13  parameters  to 
represent  the  aerodynamics,  where  the  parameter  estimates  are  from  the 
equations -of- motion  estimator,  indicates  that  the  13-parameter  case  is  the 
best.  Although  not  shown,  the  computer  printouts  of  the  transient  responses 
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from  the  Kalman  filter  also  verify  that  the  13-parameter  model  is  better. 
Thus,  the  linear  aerodynamic  representation  in  (2.9)  Was  used  for  further 
identification  purposes. 

From  Tables  7-13  and  7-16  the  effects  of  linearizing  the  nonlinear 
kinematic  coupling  term  in  the  linear  model  can  be  observed.  In  general, 
if  the  contribution  of  a  stability  derivative  to  the  aerodynamic  force  or 
moment  is  of  the  same  order  of  magnitude  as  £<3#  and  ^  representative 
of ‘.he  neglected  kinematics  in  linearization),  then  the  stability  derivative 
would  be  expected  to  be  affected.  Such  is  the  case  for  the  M  and  *ur  deriv¬ 
atives. 


Results  of  parameter  identification  in  2F197  and  2F2Q3  without  and 
with  acceleration  measurements  are  given  in  Table  7-17.  In  all  cases  P0 
was  formed  by  multiplying  the  equations -of -motion  parameter  variances 
equally  by  a  factor  of  10  and  two  iterations  were  employed  in  the  locally 
iterated  filter.  Transient  response  matching  to  measured  data  using  the 
parameters  identified  is  given  in  Figures  7-15  through  7-17.  It  is  seen  that 
the  responses  matc.ied  very  well,  especially  for  those  computed  from  the 
parameters  identified  using  acceleration  measurements.  The  exceptions 
are  the  7}%  and  Tiy  measurements.  However,  since  these  measurements 
were  so  highly  corrupted  with  noise  prior  to  manually  fairing,  particularly 
,  this  was  expected.  Note  that  matching  is  within  the  measurement 
accuracy  defined  for  these  measurements.  As  expected,  the  moment  deriv¬ 
atives  identified  appeared  to  be  consistent, but  the  X  and  Z  derivatives 
were  not.  It  should  also  be  noted  that  the  initial  estimator  used  a  ad¬ 
measurement  and  not  oCy  .  Thus  a  transformation  was  required. 


Another  test  of  the  accuracy  of  the  parameters  estimated  is  to  match 
the  transient  responses  computed  employing  the  parameters  identified  from 
one  set  of  data  to  other  sets  of  measuied  data  with  a  different  control  input. 
This  was  done  for  the  parameters  estimated  from  2F197  and  2F203  with 
acceleration  measurements.  Results  are  shown  in  Figures  7-18  and  7-19. 
Figure  7-18  shows  data  from  2F203  matched  against  the  transient  responses 
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generated  using  the  parameters  identified  from  2F197  for  both  the  initial 
parameter  estimates  from  the  equations  of  motion  and  the  locally  iterated 
filter.  Figure  7-19  gives  the  opposite  case.  Results  are  very  good  (within 
the  measurement  noise  levels  present)  even  though  the  initial  conditions  of  the 
aircraft  states  were  taken  as  the  first  measured  data  point  and  thus  could  be 
in  error. 

The  results  also  tend  to  verify  the  low  sensitivities  of  the  X  and  Z 
parameters.  That  is,  although  the  X  and  Z  derivatives  were  not  too  con¬ 
sistent  between  the  two  sets  of  parameter  estimates  from  the  different  flight 
data,  the  responses  matched  very  well,  thereby  verifying  fhat  the  measured 
responses  were  not  very  sensitive  to  these  derivatives  for  the  control  inputs 
employed  and  the  noise  levels  present.  No  identification  runs  were  made  for 
which  process  noise  was  asermed  present. 

Results  for  flight  data  2F195  and  2F198  are  given  in  Tables  7-17 
through  7-19.  Transient  response  matching  for  all  cases  except  Ff  0)  on  data 
2F198  are  shown  in  Figures  7-20  through  7-24.  Acceleration  measurements 
were  used  in  all  cases. 

At  the  time  of  these  parameter  identification  runs,  the  improved 
start-up  procedure  (Section  5.4)  was  in  the  preliminary  stages  of  development. 
Table  7-18  gives  a  comparison  of  the  equations  of  motion  s’s  to  the 
lower  bound  s‘s  (erce}  multiplied  by  -j  10  .  These  cr&li  were  computed  via 

equation  (3,  19)  with  the  ^%fi  term  neglected.  However,  they  are  presented 
here  since  results  utilizing  the  ’5  on  2F198  are  given. 

Tables  7-19  and  7-20  siiow  the  results  for  both  data  2F195  and  2F198 
when  process  noise  is  assumed  absent  and  present,  respectively.  Due  to  the 
poor  input,  (  Se^  ),  somewhat  poor  results  were  obtained  for  data  2F195  in 
all  cases.  For  data  2F198,  which  has  a  better  input  than  2F195,  better 
results  were  obtained  for  the  case  in  which  process  noise  was  assumed  pre¬ 
sent.  This  is  indicated  by  the  improvement  in  transient  response  matching 
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for  this  case  over  the  other  two  (compare  Figure  7-22,  in  which  process  noise 
was  assumed  present,  with  Figures  7-20  and  7-21  where  Q  =  0).  However, 
from  Figures  7-20  and  7-21,  transient  response  matching  is  better  for  the 
case  using  the  new  start-up  procedure  even  when  the  term  in  equation 

(3.  )9)  is  neglected.  Again,  it  should  be  noted  that  the  moment  derivatives 
identified  were  consistent,  but  that  the  X  and  Z  derivatives  were  not. 

Although  the  states  and  parameters  are  not  smoothable  when  process 
noise  is  assumed  zero,  the  fixed-point  smoothing  algorithm  can  still  be 
employed  to  obtain  a  better  estimate  of  the  initial  conditions  of  the  aircraft 
states;  this  estimate  will  be  the  same  as  backward  prediction  of  the  final 
filtered  state  estimate  to  time  tQ  .  Table  7-21  depicts  the  results  of  the  fixed- 
point  smoothing  estimates  of  the  initial  states  for  all  four  flight  records.  In 
each  case,  the  equations-of-motion  variances  were  multiplied,  equally,  by 
a  factor  of  10  to  form  PQ  .  The  initial  estimates,  in  all  instances,  were  very 
close  to  the  smoothed  estimates,  except  for  <£  of  flight  2F195,  which  is 
different  by  approximately  1  deg/sec. 

A  comparison  between  the  parameters  identified  at  %  =  45*  from 
Princeton  data  No.  154  and  flight  2F198  is  given  in  Table  7-22.  The  Princeton 
results  here  have  been  transformed  from  the  model  to  full  scale.  Recall  that 
the  Princeton  data  were  analyzed  without  modifying  the  computer  program 
to  account  for  the  additional  term  in  the  X  equation  (which  is  an  inertia 
coupling  term  from  the  Z  equation).  Despite  this  inadequacy  in  the  model 
representation,  and  inconsistency  in  the  other  parameters  such  as  c.g. 
location,  gross  weight,  model  scaling,  etc.,  it  is  seen  that  the  moment 
derivatives  compare  very  favorably. 

Unfortunately,  all  of  the  results  presented  here  for  the  identification 
runs  at  fixed-duct  Incidence  were  completed  before  the  improved  start-up 
procedure,  final  variance  computation  and  filter  consistency  test  were  pro¬ 
grammed.  Also,  additional  experiments  with  different  noise  levels,  espe¬ 
cially  process  noise  (Q)  with  the  continuous  interpretation,  may  have  been 
helpful.  However,  due  to  the  poor  quality  of  the  MPE  II  data,  additional 
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experimentation  was  considered  to  be  unwarranted. 
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From  the  limited  results  of  employing  the  identification  technique  at 
fixed-duct  incidence  it  can  be  concluded  that  the  MPE  II  flight  test  data  is 

inadequate  for  consistent  parameter  identification  of  the  X  and  Z  derivatives. 

Although  the  M  derivatives  were  identified  consistently,  there  was  insufficient 
excitation  by  the  inputs,  for  the  noise  levels  present,  to  identify  the  X 
and  Z  parameters  accurately. 

From  the  standpoint  of  instrumentation,  more  accurate  and  7j 
measurements  are  required  for  proper  identification  of  the  X  and  Z  param¬ 
eters.  Use  of  the  existing  channel  filters  may  pro^e  to  be  sufficient.  In 
general,  if  the  flight  tests  are  set  up  a  priori,  the  present  X-22A  instrumen¬ 
tation,  with  possible  simple  modification  of  the  sensor  (i.e.,  a  shock 
mount),  appears  to  be  adequate  for  identification  at  fixed-duct  incidence  of 
45  to  0°.  A  uT  -sensor  (LORAS)  or  another  way  to  measure  ur  is  required 
for  lower  speed  operation.  Clearly,  a  digital  recording  system  is  desirable 
from  the  standpoint  of  economical  post-flight  data  handling  when  large 
amounts  of  data  are  to  be  analyzed. 

7.2.4  Results  in  Slow  Transition 

Due  to  the  absence  of  good  transition  data  from  the  MPE  II  flight  tests, 
only  limited  parameter  identification  has  been  tried  on  one  slow  transition 
case  (  A/  =  -1.:-  deg/sec)  from  flight  2F197.  The  reference  trajectories  for 
A,  ,  UT  ,  Ses  and  8  were  obtained  as  the  ige  of  the  responses  for  this 
flight  and  that  of  an  equivalent  flight,  2F205.  These  references  are  shown  in 
Table  7-23.  Data  for  this  flight  are  shown  in  Figure  7-25.  A  total  of  26 
parameters  was  used  to  represent  the  model.  The  Mg  ,  X0  ,  and  ?0  deriv¬ 
atives  were  represented  by  second-order  polynomials  in  a  to  compensate  for 
inadequacy  in  the  reference  trajectory.  Using  the  results  of  Reference  1  for 
an  accelerated  transition  at  %  =  3  deg/sec  and  those  of  equilibrium  transition, 
it  was  considered  adequate  to  represent  all  other  derivatives  as  first-order 
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polynomials  or  constants.  Noise  models  employed  were  the  same  as  inose 
used  for  fixed-duct  identification  at  X  -  30*  and  are  given  in  Table  7-11. 

Process  noise  was  always  assumed  present.  To  conserve  computer  time, 
the  transformer  u.r  measurement  was  used  in  place  of  the  oCy  measurement. 

Pari  wier  identification  results  employing  the  locally  iterated  filter 
with  on.-  iterat’.un  are  shown  in  Table  7-24.  It  was  found  that  the  transient 
responses  generated  using  the  equations-of-motion  parameter  estimates 
could  not  be  integrated  beyond  three  seconds  without  computer  overflows. 
Although  it  is  not  shown,  the  same  situation  occurred  when  35  oarameters 
were  used  to  represent  the  aerodynamics.  Thus,  the  improved  start-up 
procedure  could  not  be  used  initially.  However,  results  employing  the  locally 
iterated  filter  on  5  seconds  of  data  using  the  equations-of-motion  variances 
for  P0  were  much  better.  Transient  responses  generated  for  this  parameter 
set  could  be  obtained  for  the  full  5  seconds,  although  accurate  response 
matching  was  not  obtained.  Since  these  parameter  estimates  were  better 
than  the  equations-of-motion  estimates,  they  were  used  as  the  initial  esti¬ 
mates  for  a  10  second  filter  pass.  The  final  parameter  ,-ovariances  from 
the  5  second  filter,  calculated  by  equation  (5.  56)  ,  were  used  to  form  P0  . 

Transient  response  matching  to  measured  data  using  the  parameters 
estimated  from  the  10  second  filter  pass  are  shown  in  Figure  7 -Ik.  The 
residual  sequences  and  a  few  selected  filtered  parameter  estimates  are  also 
shown.  The  residual  sequences  indicate  that  the  filter  followed  the  data  very- 
well.  However,  improvement  in  the  noise  models  could  be  made. 

It  is  expected  that  better  results  could  be  obtained  by  a  "boot- strapping" 
procedure  whereby  the  parameter  estimates  from  the  10  second  filter  are  used 
as  initial  estimates  for  another  filter  pass.  £%  would  be  calculated  by  the 
improved  start-up  procedure  without  a  priori  information,  and  increased  by 
an  appropriate  factor  for  best  results.  Adjustment  of  the  noise  covariance 
matrices  (R  and  Q)  should  also  be  considered. 

*  A  priori  information  was  employed  in  this  calculation  for  the  lower  bound. 
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Figure  7-1  Space -Fixe-*  and  Body-Fixed  Axis  Systems 
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Figure  7-5  Transient  Response  Matching  to  Princeton  Data  #55 

Linear  Kalman  Without  Acceleration,  Initial  Estimate:  Global 
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—  Response  Usin-j  Pa  remote  rs 
from  MuUi-Correeti.fl  KilK  r 

Figure  7-6  Transient  Response  Matching  to  Princeton  Data  ill  54 

With  Acceleration  Measurements  ant!  Modeling  Error,  ^CR  ^  ^ 


(continued) 


Figure  7-7  Transient  Response  Matching  to  Princeton  Data  #154 
With  Acceleration  Measurements  and  Modeling  Error, 


Figure  7-7  (continued) 


Figure;  7-8  Transient  Response  Matching  to  Princeton  Data  ti  1  b-i 
With  Acceleration  Measurement,  No  Modeling  Error, 


Figure  7-9  Transient  Response  Matching  to  Princeton  Data  #154 

Without  Acceleration  Measurements,  No  Modeling  Error, 


f#  Hjifvwf* 


(continued) 


Figure  7-10  Transient  Response  Matching  to  Princeton  Data  #157 

Using  Parameter  Identified  From  #154  (F.(l)  with  Accel.  &  Q) 


Figure  7-10  (continued) 
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Figure  7-16  Transient  Response  Matching  to  Flight  Data  2F197 
ri0W  With  Acceleration  Measurements 
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Figure  7-18  Transient  Response  Matching  to  Flight  Data  2F203, 
Parameter  Estimate  from  2F197 
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Figure  7-19  Transient  Response  Matching  to  Flight  Data  2F197, 
Parameter  Estimates  from  2F203 
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Figure  7-24  Transient  Response  Measurement  to  Plight  Data  2F)95» 
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figure  7-26a  Transient  Response  Measurement  to  Flight  Data  2F197 
in  T ransition 


Figure  /-26b  Selected  Filter  Estimates,  Flight  Data  2F197  in  Transition 


Linear  Kalman  Run  or.  Data  #55  Using 
Equations-of-Motion  Method  as  Initial  Estimator 


*  approximate  value 
NA:  not  available 


Fable  l~i\  Linear  Kalman  Run  on  Data  #55  Using 
Clobal  Values  as  Initial  Estimates 


approximate  value 
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>cale  Factors  for  Converting 
Model  Values  to  X-22A  Values 
K  =  .  1453 
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If 


TABLE 


39  ft/sec  0  0  -.02  deg 

17.5  ft/sec  0  0  -.05  deg 


TABLE  7-5 

Noise  Levels  for  Princeton  Data  Runs 


NOISE  MODELS 


MEASUREMENT  NOISE  FOR  X=  45°  and  75° 


MOTION 

VARIABLES 

MEASUREMENT  NOISE 
STANDARD  DEVIATION 

£ 

.25  deg/sec 

9 

.15  deg 

UL 

.10  deg 

or 

.15  deg 

•0075g 

_ 

.0075g 

1.5  deg/secZ 

PROCESS  NOISE  MODEL 


PROCESS 
NOISE 
STAND. 
DEV.  o' 

X  =  45°  No.  154  and  157 

X*  75°  No.  55  and  58 

COMPENSATION 
FOR  X-FORCE 
EQUATION 

10%  OF  AERO 
FORCES  AND 
MOMENT 

COMPENSATION 
FOR  X- FORCE 
EQUATIONS 

10%  OF  AERO 
FORCES  AND 
MOMENT 

0 

.05  ft/sec2 

0 

2 

.4  deg/sec 
.1  ft/sec2 
3.22  ft/sec2 

0 

.20  ft/secc 

0 

2 

.4  ueg/sec 

.2  f'./aec 
3.22  ft/sec2 
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with  feedback 
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with  feedback 


TABLE  7-10 

Flight  Conditions  for  X-22A  Flights 


A.  Fixed-Duct  Operating  Points 

Case  1:  2F195,  Time:  38:15 

1.  2200  ft 

2.  -  45° 

3.  2150  lb  F.  R. 

Case  2:  2F197,  Time:  44:30 

1.  5000  ft 

2.  X  %  30* 

3.  2000  lb  F.  R. 

Case  3:  2F203,  Time:  37:00 

1.  Altitude:  ? 

2.  k  a  30* 

3.  ?i00  lb  F.R. 

Case  4:  2F198,  Time:  38:00 

1 .  Altitude  2000  ft 

2.  k  *  45* 

3.  1900  1b  F.R. 


P .  Transition  45°  ■  »  30*  ia  l  s  -1  l/2*/sec 

Case  i:  2F197,  Time:  1:20:12  MPE  Phase  II  Flight  Test 

1.  850  lb  F.R.  FBW 

2.  Altitude:  ? 

Case  2:  2F203,  Time:  1:29:15  MPE  Phase  III  Flight  Test 

1.  Altitude:  ?  FBW 

2.  600  lb  F.R. 

Case  3:  2F205,  Time:  38:55  MPE  Flight  Test,  Composite 

1.  Altitude:  7  FBW 

2.  1850  lb  F.  R. 


MPE  II  Flight  Test 
VS  Card  #27 

MPE  III  Flight  Test 
VS  Card  #38 

MPE  Phase  III  Flight  Test 
VS  Card  #37,  no  SAS 

MPE  Phase  II  Flight  Test 
VS  Card  #27 
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TABLE  7-11 

NOISE  STATISTICS  FROM  FLIGHT  RECORDS 


MEASUREMENT  NOISE 

SENSOR 

STANDARD  DEVIATION 
<r 

WITHOUT  Q 

WITH  Q 

* 

.22  deg/sec 

.22  deg/sec 

9 

.09  deg 

.09  deg 

a 

2.6  ft/sec 

2.6  ft/sec 

toy 

.15  deg 

.15  deg  (1) 

.012g 

.01  lg 

_ 

.05g 

.03g 

2.3  deg/sec 

2.26  deg/sec2 

^C3) 

1.0  ft/sec 

- 

1.0  ft/sec 

PROCESS  NOISE  (2) 

NOISE 

VALUE 

2 

.4  deg/sec 

.1  ft/sec2 

1.3  ft/sec2 

(1)  .35°  for  2F  195  y  ,/t 

(2)  %  RMS,  e.g.  <3£  2?  .1  [  ,y  £  (ilf) 


(3)  Equivalent  noise  if  av  measurement  is  transformed 
to  ^measurement  with  oX}/  =  .15  deg 
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TABLE  7-12 

Flight  Conditions  and  Reference  Values  for 
X-22A  Fixed-Duct  Flight  Data 


FIXED  DUCT  OPERATING  POINTS 


r 

FLIGHT 

] 

i 

A 

DEGREES 

ALTITUDE 
-  FT 

FUEL 

REMAINING 
-  LB 

TIME  IN 
FLIGHT 

VS 

CARD  NO. 

5000 

K&l 

28 

mSm 

wEM 

? 

2100 

mSm 

37 

2F195 

1 

WEM 

■Kn 

38:15 

27 

2F198 

mm 

38:15 

27 

REFERENCE 

VALUES 

FLIGHT 

Ar 

/3r 

far 

9-e 

DEG 

DEG 

INCH 

FT/SEC 

FT/SEC 

DEG/SEC 

2F197 

30 

*2.8 

-.6 

mm 

14 

0.0 

j 

j  2F203 

30 

*2.8 

-.6 

■91 

14 

0.0 

i  2F195 

i 

49.7 

*3.6 

-1.0 

108 

10 

0.0 

j  2F198 

47.6 

*5.6 

-1.0 

108 

10 

0.0 

228 


Recycling  3  times 


Parameter  Estimation  From  Nonlinear  Kalman  Without  Acceleration  Measurements 


008  -.0275  !  -.021841  -.02372  -.0172007 
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Nonpcrturbed,  Radians. 


omparison  of  Initial  Variances  fP  (0)1  For  Different  Start-Up  Procedures 


**  Note  that  t.he  term  9h  f dj3  was  neglected  in  Eq.  (i.  19)  when  the 
acceleration  measurements  were  used. 


TABLE  7-19 

Parameter  Estimation  From  Nonlinear  Kalman 


Nonperturbed,  Radians 


TABLE  7-20 

Parameter  Estimation  From  Nonlinear  Kalman 


Nonperturbed ,  radians 


TABLE  7-21 


Rssuits  of  Fixed-Point  Smoothing  For  Initial 

* 

Aircraft  States 


Fixed  Duct  Incidence  X  -  30° 


States 

Data 

2F197 

Data  2F203 

Smoothed 

Estimate 

Initial 

Estimate 

%  (device) 

— 

-.229 

0914 

.913 

.  390 

&0  (detj) 

3.  19 

3.  12 

3.69 

3.78 

u0  (ithed) 

136.8 

137.  4 

135.5 

141.29 

ur0  ( ft/sec ) 

14.  52 

13.67 

14,46 

14.  59 

Fixed  Duct  Incidence  X  -  45° 


States 

Data  2F195 

Data  2r  198 

Initial 

Estin.ate 

Smoothed 

Estimate 

Initial 

Estimate 

Smoothed 

Estimate 

%  (de$/s&c) 

.  1461 

1.  197 

.  1412 

.  273 

%  (de<3) 

-.0542 

-. 2107 

1.  35 

1. 38 

U0  (it/sec) 

107 

105.  7 

111,5 

111.  1 

ur0  (ft /sec) 

12.9 

12.62 

8.  54 

8.57 

-  - . .  ■  > 

*  Results  are  with  and  Pa  formed  from 


multiplied  by  10 
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TABLE  7 -22 


Comparison  of  Parameter  Estimates  X  =  45” 

Using  Princeton  Data  and  X-22A  Data  ©<nVr»  a 


Pa  ra 

Global  Value' """ 

— 

Princeton  Data 

No.  154 

X-22A  Data 
2F198 

•% 

-.036 

-.  00751 

-.011  j 

Mur 

- .  00o44 

-.  0065.3 

-.0124 

c44 

-1.  132* ** 

-1.078 

*s 

.  300 

.  197 

.  389 

.  043 

.  057 

190 

-.  358 

.  007  1 

Xur 

- . 067  5 

0695 

> 

o 

o 

►— J 

4' 

*3 

3.  00 

.721 

-.  162 

Xfi 

,7 2? 

-.0198 

2. 

2m 

-.  180 

.221 

-.083 

2, ur 

-.413 

.  216 

-.  33 

2* 

.  900 

1. 477 

-1.35 

2* 

-1. 80 

-1.848 

*  With  pitch  rate  feedback 

**  Nonperturbed,  Radians 


;  )C 
“  -»o 


TABLE  7-24 


Parameter  Estimation  on  Slow  Transition 
Flight  Data  2F197 

i  =  -  11/2  “/sec 


Pa  ra meter 

E.O.  M. 

Iterated  Filter 

Iterated  Filter  -  10  sec 

Estimate 

for  5  sec  F  j(  1) 

Par.  &  P  from  5  sec 
Filter 

L 

53.  49 
8441 
. 00325 
284 

. 00  lb  1 
i.  538 
.  902 
14.  46 
-.  397 


54.  07 
-.  805 
.  0031 
-1.  13 
. 007598 
.  2715 
1994 
15.  86 
8224 


19.  08 
-.2363 
.000773 
-.739 
. 00555 
-.2481 
.  3256 
18.  33 
.2822 


ur 


/'V 

.778 

:  .8193 

1.871 

4 

.  0935 

i  .0917 

.07224 

l  uV : 

-.00040 

-.000388 

-.00030 

1 

/  | 

-.0375 

-.0449 

-.0449 

’  1 

6.  220 

i  5.919 

l  w 

-.  0507 

i  -o47? 

-.0493 

1 

.295 

;  .  334  j 

.  3592 

, 

-.  505 

i  -.532 

-.5157 

i 

i 

/'  1 

-9.31  j 

•  2, 

-.2717 

.  0 

1 

1 

( 

1  u2) 

! 

.000656  ! 

I  Sr 

h\ 

-.2971  1 

2 

!  'V 

1 

i 

-  6. 738  j 

r 

j  ] 

1  u  : 

;  "°59  ! 

i  ~ 

x 

■  -.  558  i 

t 

In. 

\  u) 

|  -2.905  ! 

j  1 

:  ,0^012  ; 

I  I 

-  No: 

;pe  rt-i 

rbcd.  degrees 

■10. 82 
■ .  258 
. 00063 
-.  2945 
-8.  36 
.  0706 
531 

■2.902 
.  0200 


•11.27 
-.2499 
.000588 
-.  2983 
•7. 764 
. 06475 
-.  5232 
■2. 944 
. 02037 
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SECTION  VIII 


CONCLUSIONS 

This  study  has  shown  that  there  are  four  major  ingredients  that 
constitute  a  successful  identification  of  stability  and  control  parameters  of 
V/STOL  aircraft  from  test  data.  These  ingredients  are:  (1)  a  sound 
identification  technique,  (2)  a  pioperly  designed  input,  (3)  adequate  and 
accurate  measurements  of  aircraft  motion  variables,  and  (4)  an  adequate 
model. 

1.  Identification  Technique  Development 

A  study  of  three  groups  of  available  identification  techniques  shows 

that: 


(i)  Equation-error  methods  are  asymptotically  biased  estimators 
in  the  presence  of  measurement  errors,  which  always 
exist  in  practice.  Consequently  these  methods  are 
inadequate  for  identification  of  V/STOL  aircraft  parameters. 

(ii)  Measurement-error  methods  for  response-error  methods) 
are  asymptoti  .ily  unbiased  estimators  in  th’  absence  of 
process  noise  (or  modeling  erx  r&).  Ho.vever,  in  the 
presence  of  modeling  errors,  as  is  most  likely  to  be  the 
case  for  V/STOL  aircraft,  the  response-error  methods 
give  asymptotically  biased  estimates  if  the  dynamic  system 
and/or  measurement  system  are  nonlinear;  but  the  methods 
yield  asymptotically  unbiased  estimates  if  both  the  dynamical 
system  and  measurement  systems  are  linear.  Since  the 
V/STOL  dynamics  are  nonlinear  and  modeling  errors  are 
most  Likely  to  exist,  the  measurement-error  methods  are 
clearly  inadequate. 
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(in)  v  study  of  methods  that  treat  *->oth  measurement  and 

process  errors  showed  that  the  methods  available  at  the 
start  of  tins  program  were  inadequate  for  the  V/STOL 
identification  problem  featuring  nonlinear  dynamics 
repi  esented  by  large  numbers  of  parameters,  significant 
modeling  errors,  and  measurement  errors.  Thus, 
development  of  an  advanced  technique  for  the  identification 
of  V/STOL  aircraft  parameters  from  flight  data  was 
requi red. 

\\  it h  an  understanding  of  the  basic  shortcomings  of  the  available  techniques, 
an  advanced  technique  fo;  the  identification  of  V/STOL  aircraft  parameters 
was  developed  that  is  suitable  to  do  the  job.  The  technique  is  a  scboptimal 
sequential  fixed-point  nonlinear  smoothing  algorithm  working  in  conjunction 
with  a  locally  iterated  filter-smoother  algorithm  working  in  an  "on-line1' 
fashion  to  update  the  estimates  of  the  initial  state  and  the  parameters  as  new 
measurement  becomes  available.  A  good  procedure  to  start  up  che  algorithm 
has  also  been  developed.  Applications  of  these  techniques  to  computer¬ 
generated  data  and  test  data,  both  X-22A  data  and  Princeton  Dynamic  Model 
Track  test  data,  have  shown  that  the  technique  is  suitable  for  parameter 
identification  of  nonlinear  systems  having  a  large  number  of  parameters  and 
dynamical  modeling  eirors. 

When  a  priori  information  is  lacking,  as  is  frequently  the  case  for 
parameter  identification  probiems,  an  improved  scheme  for  computing  the 
\  a  nances  of  the  fixed-point  smoothed  estimates  has  been  developed.  An 
algorithm  for  the  estimation  of  the  unknown  forcing  inputs  has  also  been 
derneu  to  work  in  a  forward  manner  after  all  the  data  have  been  processed 
through  tne  fixed-point  smoother. 

2.  input  Design 

1-  r«»m  the  study  of  parameter  identifiability  and  the  design  of  an 
appropriate  input  it  was  concluded  that: 


(i)  Sensitivity  of  the  aircraft  motion  to  parameter  variation 
is  a  good  criterion  for  input  design.  An  increase  in 
sensitivity  results  in  an  increase  in  parameter  identifi- 
ability. 

( ii)  An  input  design  that  simultaneously  optimizes  the 

identifiability  of  all  the  parameters  using  exact  optimization 
techniques  is  not  practical;  however,  suboptimal  techniques 
appear  to  be  feasible  by  grouping  the  parameters  into 
several  groups  for  the  purpose  of  sequential  identification 
of  the  group  of  parameters.  Also,  cut-and-try  methods 
based  on  past  experience  and  using  sensitivity  as  the 
criteria  have  been  demonstrated  to  be  practical, 

3.  Adequacy  and  Accuracy  of  the  'vleasurements 

From  the  analytical  study  and  the  numerical  experiments  on  the 
test  data,  it  was  concluded  that 

(i)  At  least  one  motion  variable  must  be  measured  in  each 
degree  of  freedom. 

(ii)  Accelerations  contain  additional  information,  and  should 
therefore  be  measured  and  used  in  parameter 
identification. 
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SECTION  LX 


RECOMMENDATIONS 

This  identification  program  has  been  severely  constrained  by  lack 
of  \'.ell-conditioned  X-22A  data.  The  data  that  have  been  used  were  taken 
from  the  MFE  II  flight  tests  of  the  X-22A;  these  data  were  not  obtained  for 
identification  purposes.  Consequently,  an  accurate  identification  of  the  X-22A 
could  not  be  achieved.  Thus,  in  this  identification  project,  primary  emphasis 
has  been  placed  on  the  development  of  the  techniques  capable  of  accurately 
identifying  the  parameters  of  the  model  chosen  to  represent  the  X-22A 
aircratt,  using  computer-generated  data.  Because  of  the  inadequate  flight 
data,  meaningful  correlation  of  the  parameters  identified  from  the  MPE  II 
flight  data  w'ith  those  obtained  from  wind  tunnel  data  (the  global  digital  com¬ 
puter  program)  could  not  be  satisfactorily  done.  Therefore,  it  is  strongly 
recommended  that,  first  of  all,  better  conditioned  X-22A  flight  data  be 
obtained  using  the  procedure  recommended  in  the  report  and  that  the  de¬ 
veloped  identification  techniques  be  applied  to  these  data  for  more  extensive 
c  or  relation  with  ths  wind  tunnel  d.3 13 . 

Also,  during  the  course  of  this  project,  several  problem  areas 
associated  with  the  developed  identification  techniques  were  not  completely 
solved.  These  areas  could  be  and  should  be  further  studied  to  improve 
the  techniques  and  to  enhance  their  general  applicability  to  V/STOL  aircraft. 
The  major  areas  that  are  recommended  for  future  work  are  listed  below: 

1.  Completely  check  out  the  computer  program  for  the 
estimation  of  the  unknown  forcing  functions  and  perform 
numerical  experiment?  to  verify  its  capability  of  detecting 
the  modeling  errors. 

2.  Program  the  improved  computational  algorithm  for  the 
variances  of  the  fixed-point  smoothed  estimates  and 
perform  numerical  evaluation  to  verify  the  theoretically 
predicted  results. 
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3.  Improve  the  identification  techniques  developed  by  including 
the  capability  of  simultaneously  identifying  the  covariance 
functions  of  the  process  and  measurement  noise. 

4.  Modify  the  present  identification  computer  program  to 
allow  inclusion  of  additional  mathematical  models  of  rhe 
X-22A,  both  fixed-operating  point  (FOP)  and  in  transition, 
and  to  reflect  the  coordinate  systems  in  which  the  data 

are  recorded,  and  then  apply  the  experimental  data  to  these 
models  to  determine  the  most  suitable  dynamic  models 
for  FOP  and  for  transition  of  the  X-22A  aircraft. 

5.  Program  the  complete  equations  oi  motion  for  the 
Princeton  track  model  and  apply  the  Princeton  data  to 
this  model  to  identify  the  stability  and  control  parameters 
of  the  model. 

6.  Conduct  further  study  on  input  design. 

7.  Establish  quantitative  criteria  for  the  accuracy  of  the 
measurement  instruments  (and  sensors)  required  to 
achieve  a  prescribed  accuracy  of  the  estimated 
parameters. 
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APPENDIX  A 


LINEAR  TIME- VARYING  MATHEMATICAL  MODEL  FOR  THE  X-22A 
IN  TRANSITION  FLIGHT  -  AN  ALTERNATE  IDENTIFICATION  MODEL 

If  the  reference  trajectory  is  chosen  to  be 

ue  =  f('hg), 

where  (t )  and  the  corresponding  set  of  references  for  state  and 

control  variables  are  uTe(t),  u(i)t  Qg(t),  S3g  (6)  ,  and  SeSg  (i)  ,  then  it  is 
readily  shown  in  a  straightforward  manner  that  the  first  term  in  the  % 
equation  in  equation  (2.4)  can  be  written  as 


where 


-  V0 (tj  "  V-0  (t)Au.  *■  %0  (f)AX  *  higher  order  terms 
^  A* 

=  Xo(-fde),  t*)  -  %  M 


(A.  1) 


-  /*.■  A  ^'x'o 


—  /.•  '""Of  .  \ 


Similar  expressions  can  be  written  for  the  other  terms  in  (2.4).  Then,  to 
first  order,  equation  (2.  1)  can  be  written  as 


M  \ 

A9  \ 


"*(t>  \ 


-geos9e(t)  xu(t)  xjibitii) 

-a^eR(i)  Z0(*)+te(t)  ZJL)  ) 


m$(t) 


”s£SW 


nj‘> 


*x&  J 

n(tw  \ 


(A.  2) 


Preceding  page  blank 


whe  re 


■-'A  * 

J'*  -  9(ti  9v(t) 
etc 

and 

=  -?***  -  *  *  [  *c®  *  *„(*>**  '  % 

W  =  +?*  *erqcc*9e  +  [  $,«)  *■  *  n5  **>  *»«  '  ?**rsW  *««  ] 

=  [  wjt)  ♦  ^  W  ^  '  »V  *  «Sg  +  %£S  ^  ^s*  ] 
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APPENDIX  B 

A  STATISTICAL  ANALYSIS  OF  THE  ESTIMATES 
FROM  THE  EQUATION-ERROR  METHODS 

To  begin  with,  we  shall  discuss  the  statistical  properties  of  th  •  esti¬ 
mates  using  the  equations -of- motion  error  method.  It  has  been  discussed 
briefly  in  Reference  21  that,  due  to  the  fact  that  in  practice  the  data  are 
contaminated  with  measurement  noise,,  the  method  will  generally  give  only 
biased  estimates.  Here,  we  shall  diccuss  in  detail  the  estimate  using  this 
method  and  other  initial  estimators  discussed  in  Section  3.  1. 

More  specifically,  we  shall  analyze  how  the  bias  and  the  variance  of 
the  estimate  are  affected  by  the  noise  level  and  the  data  length  used. 

Consider  a  general  case  in  which  the  process  uncertainty  is  present 
in  equation  (2.  15).  F  rom  (3.  2) 

K  M  =  *1# +**(") 

where  V(n)  5  [*/; (tj,  */f  ( *sf  (tj, . .  .f  ^  (tf)s  *  -  - ,  Vs  (t^  \  a, id 
2T*  (M)  and  A\.  represent  the  results  from  the  noise-free  measurements  and 
and  AM  are  the  corresponding  actual  measurements,  i.  e. , 

4*  '  *x°  (#)+*(*) 

where  (h)1  (*,);  ■  ■  ■;  ra  ((,),  rH  ((,),-•■, 

and  &An  are  the  errors  due  to  the  noisy  measurements  of  the  state.  The  esti¬ 
mator  using  (3.  3)  is 

-  (A„  AM)  1  An  $ v 

«  {B.  3) 

Now  pre-multiplying  (B.  1)  by  and  using  (B.  2)  and  (B.  3)  yields 

J  *  (A„  AjAjAl  *+  f  '-ZaJ*  A J  (<S(»)+VX(H)) 


(B.  2) 


Thus  the  error  of  the  estimate  becomes 

A  r 


■P'P  *  ( V  A»  f 


(B.4) 


(B.5) 
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The  bias  of  the  estimate  is 


E  [*-*}  *  - pE  [fA/A¥f\r4AM] 


( B.6 ) 


(B.7) 


and  the  mean  square  of  the  estimate  is 

=  £  [(Af. Avy*  A, / (*r (N) +X  •*■)-  irt  (v)~  bkrff* 

.  A  /A  rA  1-,1 

-V  <  flA‘  M *  >  j 

*  a  [.- aJ an yf  aJ ( wM *  vN ) a„  ( aJ a„)'4 

*  (AjKf  aJ  *aS  a»(aj 

where  Vv^  and  Up,  are  the  covariance  matrices  of  uf[*l)  and  v2Ln)  respectively. 


F  rom  (B.6)  and  (B.7),  it  is  evident  that 

(i)  The  estimate  p  is  biased,  even  if  the  noise  vector  in 
the  acceleration  measurements  t£(V)  .and  error  vector 
in  the  equations  of  motion,  ut(n)  ,  have  zero  mean  and 
are  independent  of  A#  . 

(ii)  The  bias  of  the  estimate  is  affected  solely  by  the  error 
in  the  state  variables1  measurements  as  long  as  the 
errors  in  the  acceleration  measurements  and  in  the 
equations  of  motion  are  zero  mean. 

(ill)  The  variance  of  the  estimate  is,  however,  affected  by 
■he  noise  level  of  all  the  measurements  and  by  the 
equations-of-motion  errors. 

Qua* itatively  speaking,  it  is  also  evident  from  (B.6)  that  the  percentage  bias 
is  dirtated  by  the  signal-to-noise  ratio  in  the  state  variable  measurements. 
Indeed,  If  the  signal-to-noise  ratio  is  infinite  (i.e.,  no  measurement  errors 
in  the  state  variables),  there  is  no  bias;  if  the  signal-to-noise  ratio  is  zero, 
then  the  parameter  estimates  become  i00%  biased. 
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Questions  remain  as  to  how  :he  bias  is  aifected  by  the  data  length 
for  a  given  signal-to-noisc  ratio,  i.e.,  does  an  increase  in  data  length  help 
reduce  the  bias?  In  other  words,  what  is  the  asymptotical  behavior  of  this 
bias?  The  answer  to  these  questions  has  also  been  found.  In  the  tollowtry 
analysis  it  is  shown  that 


The  estimate  is 


biased.  Thus,  use  of 


longer  data  records  does  not  help  reduce  the  bias. 

The  bias  increases  as  the  signal -to-noise  ratio,  af/cr^  , 
decreases.  For  single  parameter  cases,  the  percentage 
bias  is  given  by  1  * 

1  f 

of  the  true  value  of  the  parameter.  Similar  results  have 
also  been  obtained  for  n-parameter  cases. 


In  order  not  to  be  bogged  down  by  the  complicated  matrix  algebra 
which  tends  to  obscure  the  basic  ideas,  we  shall  consider  a  single  scalar 
equation 

*  = 


with  the  measurements 


(B.  8a) 


(B,8b) 
(B.  8c) 


We  shall  later  extend  our  results  to  the  vector  equations.  Substituting 
(B.8a)  and  (B.8b)  into  (B.8c)  there  results 

Thus,  from  the  viewpoint  of  classical  linear  regression,  the  combination  of 
the  equation-of- motion  error  and  the  error  in  the  measurement  of  the 

acceleration  *s  what  is  important.  Consequently,  there  is  no  loss  of 
gereraiity  to  assume  that  -  0  and  that 


i,j  *  .a  ih  h..  j.Tdm.ta* MljIA 


(B.  9a) 


5  [rj.  e\*i\  =  £  [nn\  ' e 


M  - 


;B.  9b) 


£  13  J 


3 


(B.  9c) 

In  other  words,  equation  (B.8a)  is  deterministic;  the  measurement  errors  in 

the  state  variable  and  the  time  rate  of  the  state  variables  are  zero  mean, 

2  2 

independent,  and  with  finite  variance  fff  ,  and  respective:*/. 

Upon  an  application  of  the  classical  linear  regression  to  (B.9)  there 
results  a  sequence  of  estimates  for  the  parameter  a.  co -responding  to 
the  number  of  samples: 


A 

" 


h  &  pt 


•t* 


A 

a. „ 


h 

if  *  ‘h  It 

^  2  (‘/f'h'frh)  a  ft_ 

i  ($*+  vi) 

1  J  ~ 

-  izt  ■*  >1 


i  r  * 
"  h.  % 


one  data  point 


two  data  point; 


rt  data  points 


(B.  10a) 


(B.  10b) 


(B.  10c) 


<:( 


First,  we  shall  consider  the  one  sample  (one  data  point)  case.  We  have 

Ji 

,  2 


4 

* 


Since  and  jr  ;  a  re  Gaussian  random  variables,  i.e.,  have  density 

functions 

/  _5Lj 

Sr* 


*(**)•#(<>,  Cl1)*- 


-rzfT  erx 


*5 


& 


it  is  clear  from  (B.8a)  and  (B.  10a)  that  and  are  also  normal  variables. 
In  fact. 
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(B.  11a) 
(B.  lib) 


*  '-it,)  =  *  (t,9  of)  (B.  11a) 

*  (h)*  N  (**99*/’)  (B.llb) 

Since  v;  ( t f)  and  t/j  f^)  are  independent,  hence  yf  and  ^  e  also  indepen¬ 
dent,  and  hence  and  f}  are  jointly  normal.  It  follows  that  tsee,  for  instance, 
page  197  of  Reference  65) 

,  oo  o 

^ (^f)  *  j  "  -1^  i  Vt) dyf 


to 

*  /  ^  & 1  -J  4/, )  *V,  •  _4  %  *y  *A */  )  ^  4  y,  )  dyt 


(B.  11c) 


Using  (B.  1*>  and  a  great  deal  of  algebraic  manipulations,  it  was  found  that 

if 


where 


f/aj*  ■ 

2crz  (rf/  *£/*,*+ if  J 


(B.  12a) 


__  3* 

5  55 

4/ a  /°i)2 


(B.  12b) 


_  _JL  *  -*& 

L  e 

We  now  examine  the  two  limiting  cases,  i.e.,  2)  and  « 

From  (B.  12a),  it  i3  readily  seen  that 

(1)  HI.) *  - -  *s  —L+0  _A  „ 

*[*t  +  (*&/]’  **  9  ffr  "" 

.  .  /  f  /  z  „  (B.13a) 

(2>  /ft,)- - : — e-* (%)(•>-*)  „ 

yw(er‘ /v,) 


253 


(B.  13b' 


f(‘dj  = 


Thus,  it  is  recognized  that  as  signal  x  approaches  zero,  the  estimate 
approaches  the  Cauchy  distribution,  resulting  in  a  100%  bias.  On  the  othei 
hand,  as  the  signal-to-noise  ratio  increases  without  bound,  the  distribution 
approaches  a  delta  function  occurring  at  a,  =  ft  .  The  bias  as  well  as  the 
variance  of  the  estimate  is  zero,  indicating  that  the  estimate  is  the  true  value 
of  the  parameter.  Actually,  this  comes  as  no  real  surprise,  because  the 
problem  at  hand  becomes  purely  a  deterministic  one. 

Figures  B-l  through  B-3  show  the  plots  of  (B.  12a)  for  different  values 
of  sigr.al-to-noise  ratio,  i.e.,  %/g  -  0,  l,  and  10,  assuming  that  e.  =•  sz  s  a 
and  ft-  =  1.  Note  that  in  these  conditions,  the  percentage  bias  can  be  ex¬ 
pressed  as 

/  >  (*/cr)z  *  000  %  (B.  14) 

We  now  proceed  to  examine  the  cases  when  more  data  are  used.  We 
may  proceed  as  before  for  n  -  2,  3,  . . . ,  but  the  algebra  becomes  too  com¬ 
plicated  to  warrant  this  approach,  and  we  shall  not  pursue  this  line  further. 
Rather,  we  shall  examine,  in  detail,  the  asymptotical  properties  of  the  esti- 

A 

mate  dr  ,  as  r>  oo. 

With  reterence  to  equation  (B.  10c)  it  ir  readily  seen  that  both  the 
random  sequences 
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are  independent  with  respect  to  their  own  elements,  that  is,  y-  fa  and  yjfj 

jj  m  , 

are  independent;  further,  y.  and  yj  are  also  independent  for  all  1±*  fj  -  O. 
By  the  central  limit  theorem,  f. and  de-’ined  in  (B.  10c)  will  both  approach 
normal  distributions  as  »•**>,  i.e., 


t  n 


normal  variable 


normal  variable 


as  77  -*•  OO. 


To  provide  a  common  ground  for  comparing  the  statistical  properties 
of  an  as  n+eo  and  d,  ,  and  to  simplify  the  algebra,  it  is  convenient  to  con¬ 
sider  that  the  signal-to-noise  ratio  is  constant.  (In  practice  this  condition  is 
relatively  hard  to  realize,  since  %(t)  i3  changing.  However,  if  r(t)  is  a 
stationary  random  process  such  as  the  motion  of  the  airplane  resulting  from 
random  gust  excitations,  it  is  realistic  to  assume  a  com-tant  signal- to-noise 
ratio.)  With  this  assumption,  we  have 


^  [f/i'Ji]  =  ~  ^ 


(B.  15) 


*  [*?]•  <  +<*  +*;0? 

Recall  that  -pn  and  (}„  are  sample  mean  for  f  v,  f/J  and  {%*}  respectively; 
their  mean  and  variance  are  respectively 

£  [a]  - 

£  [ffl, -«*;*]»  c£  -o  -k  a> 

c  f  1  2  l  (B* 16> 

£[U\  ‘  «  *<£, 

£  [  (fn  '  * * ~  *7*]  *  *5  *  A  V--  CG 


V7-»>  OO 


Thus,  the  density  functions  of  -pn  and  as  v-*oo  are 

~  1  Tit/ 


(B.17) 


jz.  *  (f*> 
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v'here 


a.  l  */rf)~ 


C  §  #*■(-  >Jf 


Since  and  both  approach  normal  variables  as  n  *>  oo  ,  the  re¬ 
sults  ootained  for  a1  ,  which  we  recall  is  a  ratio  of  two  normal  variables, 
can  readily  be  used.  By  comparing  (B.  17)  with  (B.  11),  it  is  easy  to  see  that 


(B.  18a) 
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Carrying  out  the  limiting  process  yields 


Zirn 
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fl-T)  f  X 
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This  new  result  servts  to  answer  the  two  important  questions  pre- 
viously  raised.  We  conclude  that 


The  estimate  £  is  asymptotically  biased. 

The  bias  depends  solely  on  the  ratio  of  the  signal  to  state 
variable  measurement  noise,  ^/<y;  and  is  given  by 


1 

«''**-*'  L  t  +(v/crtf\ 


In  the  language  of  probability  theory,  equation  (B.  18)  says  that  the 
sequence  of  the  estimates  |£WJ  converges  to  a.  with  probability  one,  as  n-*oo. 


The  above  asymptotical  analysis  for  a  single  variable  case  can  readily 
be  extended  to  a  multi -para  me  ter  case.  Consider  a  two-parameter  system 

i  -  *  by 

f***  (B.l?) 

#  =  * +  tr,  ,  if  *  e/it% 

where 


M  - * M  * 0 

E.  [V]  *  o  z 

£  [V]  =  <5*  ,  £  [«5*]  ‘  *f 


(B.  20) 


and  u  ,  vt  and  tfz  are  independent.  By  a  similar  analysis  as  for  the  single 
parameter  case,  it  is  not  difficult  tc  show  that 


(B.  21) 


with  probability  one.  Namely,  and  b  n  converge,  with  probability  one,  to 


j 

[in' 

r  r  *  -1 

tfvo;*  *y 

.1 

~v  (A.V+6t/)~ 

]  *>7  -*00 

i 

*4 

_ i 

ij  (a.*  hby) 

(B.22A) 


(B.  22b) 


257 


For  the  general  k-parameter  case 


*,  =  -p,  -b  4-z  +  *t>s  +  •  •  *  *  -Pa  *4 
with  the  measurements 


where 


£  [<]  = 


i  5  *,  *  u 


(B.  23a) 


(B.  23b) 


^  [%*j  *  *--1  y  Zy  •  •  • ,  Jz 

and  u, ,  vc  are  independent,  the  estimates  of  the  parameters  ,  (■ Pz)n> 


•  •  •  * 

(hK 
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(B. 23c) 


with  probability  one.  Namely, 


(4i . 

4. 


17  -*■  Op 


(B.  23d) 


Zs  ^  A  *  •  •  9  4 


with  probability  one. 


The  other  equation  error  methods  discussed  in  Section  3.  1  are  also 
asymptotically  biased  estimators.  The  birs  of  these  estimators,  like  that  of 
using  the  equations -of-motion  method  discussed  earlier  in  this  section,  stems 
from  the  fact  that  the  regressor  in  the  least  square  fit  is  stochastic  (due  to  the 
errors  in  the  state  variable  measurements)  and  the  fact  that  the  regressor 
and  the  errors  in  the  least  square  fit  are  correlated. 

Consider,  for  instance,  the  Denery's  initial  estimator  (see  Appendix 
C).  The  matrix 
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/*{»*!$))'+<*  j«- 

in  (C.9)  is  stochastic,  since  (i)  is  a  solution  of  the  stochastic  differen¬ 
tial  equation  (C.8).  Further,  this  matrix  is  clearly  correlated  with  the 
vector  in  (C.9) 


f**  \ u  (s;  1  ?;\lr 
,  I  MS  ■'  5/ 


dt 


Sp  *  ^  /J 

r  I  ^  n  T 

Thus,  the  estimates  I  jp  \  A*0  in  (C.  9)  are  asymptotically  biased. 

Consider  next  the  polynomial  estimator  and  the  modified  (floppy) 
spline  function  estimator.  For  the  purposes  of  illustration,  consider  a  single 
parameter  case. 

X  —  A/% 

V  S  *ytr  (B.  24) 

First,  we  fit  a  time  function  y  (i)  using  a  set  of  deterministic  base  vectors 
(polynomials  or  modified  spline  functions)  to  the  state  measurement  y  (*)  . 
For  A/  sample  points  (see  Equation  3.7). 

4  A  A 

_/  r 

=  yM 

S  XcJ„  =  &  (l£v  + 

where  ^*4#(AA/r ^  is  a  deterministic  matrix. 

Then,  since  -  ClX^  ,  (B.  25)  yields 


(B.  25) 


(B.  26) 


and  the  least  square  fit  a.^  to  o.  in  (B.  26)  gives 


,/i  r  4  1  r  d 

*4*)  $ n  y* 


*  **  +  ($**  Z* )''%  (* rv  - 

Since  is  a  random  vector  and  is  correlated  with  (ATt rlt-a,Hv'K  )  in 
(B.  27),  the  estimate  is  again  asymptotically  biased. 


(B.  27) 
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APPENDIX  C 


DENERY'S  INITIAL  ESTIMATOR 


In  the  following  discussions  of  this  technique,  it  appears  to  be  easier, 
insofar  as  conveying  the  basic  idea  is  concerned,  to  use  a  multi-output  phase 
variable  form  (Reference  66)  rather  than,  using  Denery’s  canonical  form  pre¬ 
sented  in  his  original  work  (Reference  12).  Consider  a  linear  system 


(C.  1) 


X  -  Fy,  +  Ga 
ij  =*  Uv  +  tr  j 

where  %  is  the  stats  vector,  (n-vector);  U  is  the  control  vector,  (r-vector); 
y  is  the  output  vector,  (m-vector);  and  V'  is  the  measurement  error  vector. 
I fw<M,  there  are  generally  infinitely  many  sets  of  {  F ,  £  ,  //  )  that  can  fit 
(C.  1)  as  far  as  the  input-output  relationship  is  concerned.  To  be  specific, 
therefore,  we  shall  assume  that  we  are  to  fit  *he  system  (C.  1)  by  the  follow 
ing  system 

%  *  F„*  +G„u,  ,  %(c)  =  %D 

jj  =  Hdt  (C.  2) 

where 


r 

o 


which  is  represented  in  the  phase  variable  form  (see  Reference  66).  Notice 
that,  as  far  as  the  input-output  relationship  is  concerned,  the  two  systems 
are  equivalent  if  noise  tf  is  not  present  in  (C.  1).  It  is  to  be  noted  also  that 
the  unknown  parameters  in  <fc  affect  the  output  y  in  a  nonlinear  fashion,  but 
the  parameters  in  G0  affect  the  output  linearly.  The  n  x  m  parameters  in  o c 
are  to  be  related  to  a  set  of  n  x  m  parameters  that  affect  the  output  linearly. 

Consider  a  "filter"  with  gain  matrix  K,  which  has  a  total  of  n  x  m 
parameters,  that  operates  on  the  output  tj  in  conjunction  u,Uh  the  system 

i’V  (C.3, 

Notice  that,  in  the  absence  of  the  measurement  noise  V  in  (C.  1),  (C.  3) 
reduces  to  (C.2)  regardless  of  the  filter  gain  matrix  K.  Let 


S  -S.-SG 


(C.4) 


PicctiiiE  page  Unk 
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Thc'n,  by  choosing  FM  and  Gjj  ,  F.  and  Q0  are  uniquely  determined  if  K 
and  §6  are  first  determined.  Using  (C.4),  (C.  3)  becomes 

GNu  +  f&y  +  SGv)  ,  x(o)  =  v.a 

5-^.5  <c*5> 

It  is  seen  from  (C.  5)  that  is  linearly  related  *.o  K,  ,  and  Av0  , 

where  y  =  yH  +  Axo  .  Indeed, 

£  W  4  j  **  *■  e  e  [***  W  to]  ^  *  e  ^  d  *, 

=  iiM  (*)  *  >ieF*i !&%,  *  fer” Z  [sGu,(z)  *■  ty(T)dr\  J 


(C.  6) 


whe  re 


ana 


'%  to  =  tip  *„(*■)> 


c 

^  *  J s.  *** G/fU’(z)dT 


Let  us  now  arrange  the  unknown  parameters  in  §&  and  K  as  the  components 
in  the  parameter  vector  *0  .  Then 


where  the  matrices 


ot 


d%  I  9% 
9f  1*4  *4>~(m.r]\  **< 

following  linear  differential  equations: 


■[ 


d% 

9%~ 

do 

3V 

H*.. 

9% 


(C.7) 


are  the  solutions  of  the 


d  9i  9%  9  9*  ,  9Z 

+  (Sa)u(d  +  tj(i)  ,~—(p')*-0  ,  i-  1,2, ... }7)(rtt+r) 
dt  dpL  3f-  %  %  Gpi 


(C.  8) 


d  dr 


di 


dt  9yo  "  dxg 


Using  tne  same  performance  index  as  in  the  measurement  error  methods, 


J  (>i~ 5 f  *('!-$)& 


the  parameter  vector^?  and  b%0  can  be  computed  by  minimizing  J  without 


ite  ration. 
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(C.  9) 


utH.i'UTi  -v-  -.-j-,j,”'j-"-1’-1  ■• 


For  the  special  case  in  which  all  the  state  variables  are  measured,  H0  = 
and  (C.9)  is  further  simplified.  By  comparing  (C.8)  and  (C.  9)  with  equations 
(4)  and  (5}  of  Reference  21,  it  is  seen  that  they  are  identical  in  form  with  the 


M. 


exception  of  the  term  -jp —  lj(t)  in  (C.8).  Thus,  this  term  can  be  replaced  by 

~~  %(t )  after  the  first  iteration  (which  computes  the  initial  estimates),  and 
°fi 

a  unified  estimation,  procedure  is  thereby  achieved. 


dK 

When  measurement  noise  is  present  in  (C.  1),  the  term  y(t)  in  (C.8) 
is  a  random  process  and  the  solution  (C.9)  resulting  from  applying  the  linear 
regression  is  biased.  This  and  other  statistical  properties  of  tne  equation- 
error  methods  presented  here  are  discussed  in  greater  detail  in  Appendix  B. 
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APPENDIX  D 


COMPUTER-GENERATED  DATA  FOR  IDENTIFICATION  STUDY 


Several  possible  techniques  exist  for  parameter  estimation  of  non¬ 
linear  dynamic  systems,  as  discussed  in  Section  III.  In  order  to  evaluate  the 
relative  merits  of  these  various  techniques,  such  as  accuracy,  convergence 
properties,  computing  time,  storage  requirements,  etc.,  time  histories  of 
a  system  representative  of  the  X-22A,  with  known  parameters  and  noise  sta¬ 
tistics,  are  needed. 


The  subject  set  of  data  was  generated  by  integrating  a  set  of  longitu¬ 
dinal,  tnree-degree-of-freedom  equations  of  motion.  The  values  of  the  sta¬ 
bility  and  control  derivatives  used  as  shown  in  Table  D-l  were  the  best 
approximations  to  the  "global  aerodynamic"  data  (Reference  1).  In  all  the 
cases,  independent  unfiltered  random  noise  sequences  with  Gaussian  distri¬ 
bution  and  zero  mean  were  added  to  the  outputs  of  the  state  variables  and 
their  derivatives,  simulating  measurement  noise.  In  addition,  for  some  of 
the  cases  the  same  type  of  noise  sequences  was  added  in  the  equations  of 
motion  to  simulate  gusts.  The  trim  values  were: 


-  30  degree  90  =  2.  362  degree 

U'o  -  130  ft/sec  fto  -  17.257  degree 

-  5.  362  ft/ sec  Ses0  -  -  . 637  in. 

Both  linear  and  nonlinear  models  were  used.  They  are: 

1.  Nonlinear  Model: 

Dynamic  System  Equations 
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(D-  la) 


where  the  components  it,  and  «,  are  the  components  o(  the  disturbance 

or  gust  vector  and  $  is  the  gravitational  constant. 


Measurement  System 

y  =  X  *■  Srt 
}*  }  *  Cn 

where 


x  -  u 
w 


7 ,z  •  -J  (u,  +  (j,  ur)  *  &m  & 

(itr  ~  fyu)  -  Cos  6 


(D-  lb) 


„  and  m  are  the  noise  vectors,  whose  elements  are  sequences  of  random 
numbers,  and  B  and  C  are  diagonal  matrices  made  up  of  the  standard 

deviations  Oi  for  the  noise  sequences.  Two  levels  of  noise  were  used.  The 
one  considered  to  be  "low"  has  standard  deviations  chosen  to  approximate  ^ 
the  requirements  in  Reference  67.  The  other,  considered  to  be  "moderate", 
is  five  times  greater  (see  Table  D-  2). 

2,  Linearized  Model: 

Dynamic  Equations 
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*  is* 
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1*4  ** 
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NOTATION  *F 
PANAMETCN3 


DIMENSION 


VALUE 


UNEAI  t?S,  OF  MOTION 


I /SEC  I /IN. -SEC2 


.007$  j  -.62$  I  .100 


FT/ IN, -SEC2 


-.ISO  I  .021  I  1.370 


-.216  I  -.650  1.66 


NONLINEAN  EOS.  OF  MOTIOr 


COMBINED 

FAIAMETEN 


COMBINEO 

DIMENSION 


M,(U) 

as  (“)  ! 

l/SEC 

l/IN, -SFC2  1 

-.w 

-,00103 

.327$ 

.001167 

ET/SEC2  1/$£C 


FT/IN. -SEC2 


TABLE  D-2  Measurement  and  Process  Noise  Characteristics 


(PNOCESS 


CONSTANT 

COEFFICIENTS 

COEFFICIENTS  ABE 
1st  OBOEt  FUNCTION 
OF  u  EXCEPT 

•<>(«).  **° 

.  SEIMS  2n«  MOEN 


NOISE  ADO ED 

I  MEASUNEMENT  NOISE 
ONLY 

MEASUNEMENT  NOISE 
PUIS  "6IIST*  NOISE 

MEASUNEMENT  NOISE 
ONLY 

MEASUNEiCNT  NOISE 
PLUS  "6UST*  NO!'* 


STAND  AND  DEVIATION  O' 

LOV 

MOOENATE 

1.0  FPS 

5.0  FPS 

1.0  FFS 

5.0  FPS 

0.2  0E6/SEC 

1.0  DES/SEC 

0.5  FPS 

2.5  FPS 

0.07$  FPS 

0.375  FPS 

0.03  0E6 

0.15  0E6 

0.01  0E6/SEC 

0.05  DES/SEC 

0.001  o 

0.005  • 

O.OOS  i 

0.0025  0E8/SEC2 

0.025  | 

0.0125  0E6/SEC2 

LEVEL  OF  NOISE 

DESIGNATION 

LOV 

l-A 

MOOENATE 

l-C 

LON 

1-0 

MOOENATE 

1-0 

LIW 

2-A 

NOOtNATE 

2-C 

U PI 

2-1 

MOOENATE 

2-0 

panameten 


I  DIMENSION 


*„(*) 

t/FT-StC 

l/SEC 

l/SEC 

In  integrating  the  equations  of  motion,  these  gusts  were  held  constant 
during  each  integration  step.  Because  of  "zero-order  hold",  the  variances 
of  these  gust  become  -SL-  . 
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PERTURBED  PARAMETERS 


From  equations  (2.8)  ^nd  (2.  10),  it  is  seen  that  the  aerodynamic 
terms  are  expressed  as  third  degree  polynomial  in  forward  speed  u  .  Based 
on  numerical  experience,  it  was  suggested  by  Dr.  J.T.  Fleck  and 
Mr.  D.B.  Larson  of  the  Computer  Mathematics  Department  of  CAL  that  a 

benei  numerical  condition  would  result  if  the  parameters  were  expressed 
in  the  perturbed  values  during  the  identification  process.  Consider  a  typical 
term  in  (2.  10)  (  with  reference  notation  R  dropped). 

m4(u)  =  &,  Z  (E.  1) 

Let  us  express  the  parameter  vector  af  as  a  "perturbed"  value,  i.e., 


mju)  *  dt  2  »  a  R 


where 

to 

=  u-u.0 

and 

% 

Using  (E.  1), 
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,  and  (E, 
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V 
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i 

(E.2) 

(E.3) 


is  related  to  dt 

(E.4) 


(E.  4a) 


(E.4b) 


These  transformation  pairs  ar;  the  same  for  all  the  16  parameter  vectors 
in  (2.  10). 
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APPENDIX  F 


DESIGN  OF  INPUT 

The  design  of  input  signals  for  parameter  identification  has  long  been 
recognized  as  an  important  ingredient  to  a  successful  identification  of  param¬ 
eters.  However,  design  procedures  based  on  optimization  techniques  have 
not  been  discussed  until  recently  (References  68-71). 

In  our  early  numerical  experiments  using  sensitivity  of  the  aircraft 
motion  to  parameter  variation  as  a  criterion,  we  found  that  a  better  input 
function  did  exist  and  did  drastically  improve  the  parameter  estimation. 

Tables  F-l  and  F-2  show  the  results  of  applying  an  initial  estimator  and  the 
linear  Kalman  program  to  a  system  responding  to  two  different  control  inputs. 
The  results  clearly  show  the  effects  of  the  control  input  on  the  quality  of  the 
parameter  identified. 

In  fact,  if  we  use  mean  square  estimation  error  as  the  criterion  for 
the  quality  of  the  parameter  estimation,  the  best  performance  for  a  given 
set  of  input  functions  (and  hence  the  data)is  given  by  the  Cramer-Rao  lower 
bound  (Reference  29).  Therefore,  the  design  of  inputs  may  be  formulated 
by  attempting  to  minimize  the  Cramer-Rao  lower  bound.  Since  the  Cramer- 
Rao  lower  bound  is  related  to  the  inverse  of  a  norm  of  the  sensitivity  vector 
functions,  the  problem  then  amounts  to  a  maximization  of  the  sensitivity 
vector  functions. 

To  make  the  minimization  problem  meaningful,  constraints  on  the 
magnitudes  of  inputs  and  the  state  variables  must  be  added  so  that  the  equa¬ 
tions  of  motion  for  the  vehicle  will  remain  valid.  Unfortunately,  the  design 
of  an  input,  when  formulated  in  this  manner,  becomes  a  typical  optimal 
control  problem  requiring  a  solution  of  a  two-point  boundary  value  problem. 

Instead  of  solving  the  two-point  boundary  value  problem  associated 
with  a  large  number  of  differential  equations,  we  present  first  an  attempt 
to  find  a  suboptimal  solution  using  a  technique  similar  to  that  used  for 
parameter  identification.  We  then  present  an  attempt  to  solve  the  actual 
two-point  boundary  value  problem  with  a  smaller  number  of  parameters. 
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Statement  of  the  Problem 


Consider  the  dynamic  system  and  the  measurement  system  (F.  l)and 
(F.2)  respectively,  i.e.: 

*■  =  /(<-',  pr  -no)  *(o)~  j£0 

(F.i) 

lJ  »  e  {  V ,  -m )  t  Tr( i ) 

where  as  usual  £jrJ*o  and  £  fv'(t)ir'r(r)J  =  £  $(t- X)  (F.2) 


(F.i) 


(F.2) 


It  is  desired  to  minimize  some  norm  of  the  Cramer-Rao  lower  bound  matrix 


for  the  covariance  of  the  estimation  error,  where 

C  #  9h  £*]  Tff\9A  9*  1  MW 

€  \l  \  |  9?  g*  $  ft  -  U*  \  \  Ip*  9¥  9p. 


atti  (F .  3) 


subject  to  the  constraints  on  the  sensitivity  equations  (F.4)  and  (F.5)  i.e., 

A  /£M_  I1L)  I ll 

at  \9e)  (  2tj  \  p* ) 9  9*}  77  (F.4) 

V  0 


■  — ~  v - - “V  ~ 
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—  (o)„r 
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o 


at  l *p)s \Hl\lfil+  9p  9  9p(^*° 


(F.5) 


and  to  the  constraints 


i^i  6  M  and  IX J  £  X 

/$ 

J  Q  (it,  -m)  dt  £  V 


(F.  6a) 


(F.  6b) 


The  constraints  (F.6)  are  required  for  the  mathematical  model  (F.  1)  and 
(F.2)  to  remain  valid.  In  equation  (F.6),  M  and  X  are  constant  vectors;  K 
is  a  scalar  constant;  and  Q  is  some  cost  function. 


A  Suboptimal  Input  Design 


The  problem  as  stated  in  the  preceding  pages  is  a  typical  optimal  con¬ 
trol  problem  for  a  nonlinear  system  with  a  large  number  of  equations. 

Indeed,  even  if  one  uses  the  linearized  representation  for  VTOL  aircraft 
dynamics,  for  instance,  the  input  design  for  a  ten- parameter  problem  be¬ 
comes  an  optimal  control  problem  with  constraints  on  44  differential  equa¬ 
tions  (4  original  equations  of  motion  plus  40  sensitivity  equations)  instead  of 
just  the  original  fourth-order  system.  This  is  a  formidable  two-point  boun¬ 
dary  value  problem! 

To  circumvent  this  difficulty,  one  may  seek  a  much  simpler  suboptimal 
solution.  Instead  of  choosing  the  control  input  function  from  all  those  admis¬ 
sible,  one  can  restrict  oneself  to  choose  from  those  which  are  a  linear  com¬ 
bination.  of  the  solutions  to  a  set  of  chosen  linear  time -invariant  differential 
equations.  This  reduces  the  two-point  boundary  value  problem  to  a  much 
simpler  problem  of  parameter  minimization,  much  the  same  as  the  measure¬ 
ment  error  parameter  identification  problem.  Thus,  the  design  of  the  input 
can  be  carried  out  using  the  existing  computer  program  for  identification 
with  some  modifications. 

Consider  a  linear  time -invariant  system 

V.  =  FV  +  Q-m  y  4.(0)  =  (F.7a) 

if  =  4t  -b  If  (F .  7fc) 

Then  a  suboptimal  control  problem  can  be  formulated  as  follows: 

Find  Yn{i),0<-t  £tf  to  minimize 

/ 

X-  j  jj  h  <F'8!* 

^  0 


*  Ct±i  was  used  instead  of  jC2j ^  in  the  computer  program.  However, 

this  should  not  adversely  affect  the  results,  as  the  diagonal  terms  of  02 
are  all  positive  anyway. 
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subject  to  the  c<  nsf.raints 


V-  =  v  G,,/*)  i  <Uoh  V0  (F.  9a) 

^At~  S i  *  9  fyicj-O,  2  =  t,2,  ..-yfy  (F9b) 


where 


n  5 

Le  - 


*  l  C  [*.  4  •  "  hY *''  [*"  **>  •  •  • ■ s*  j «  f '- 


l%-) 


and  the  control  functions  7n(t)  are  restricted  to  those  that  can  be  generated 
from  a  linear  system  of  known  form, 


j  =  4,*  fW'A 

7J7  - 


(F .  10) 


where  the  elements  in  S  and  the  initial  vector  ^  are  unknown  parameters 
to  be  determined  by  minimizing  J  . 


NOTE:  Fn  ,  6>N  are  nominal  system  matrices,  Fjj.  ,  Gjj.  are  partial 
derivatives  of  F  and  Ct  with  respect  to  stability  and  control  derivatives  to 
be  identified. 


The  suboptimal  input  design  problem  as  formulated  above  is  a  typical 
parameter  optimization  problem  such  as  the  measurement  error  method. 
Table  F-3  shows  a  sample  run  using  the  conjugate  gradient  method.  In  this 
computer  run,  the  following  parameters  were  used. 

%-  (U  *  '•  * 

f  j  Z  -  fi  2t 


q  =  foy 


-/ 

e  = 


*  •  •  9  /o 


lff  =  o.of 


f.  384 
0 
0 
0 


0 

1.7 ft, 
o 
0 


o 

0 

(,7800 


o 

0 

o 

400 700 


**  (*y  <h  ef 

<?,  -  I4,  Qz  =  At=  0.1 9  ^=5: 

and  and  Gw  are  as  shown  in  Appendix  D. 
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iwo  cases  were  considered;  one  utilized  4  modes  and  the  other  one 
utilized  8  modes.  The  initial  guess  values  and  the  final  values  for  3  as  well 
as  the  time  histories  for  the  control  inputs  Sfs(t)v/ere  also  shown  in  the 

table.  Notice  that,  although  the  signal  power  is  smaller  for  the  8-mode  case 
than  for  the  4-mode  case,  the  C£  values  are  smaller  for  the  8-mode  case, 
resulting  in  better  parameter  identification. 

In  the  above  numerical  example,  one  ^may,  of  course,  vary  the 

weighting  so  that  the  final  input  power,  J  ,  or  signal  power 

be  made  approximately  equal  to  those  of  the  initial  input  power,  J  (B0e*"i)dt- 

o 

However,  due  to  limited  time  and  money,  this  experimentation  was  not 
carried  out. 

We  now  discuss  another  method  which  is  a  direct  solution  to  the  actual 
two- point  boundary  value  problem. 

An  Optimal  Input  Design  Method 

Instead  of  minimizing  some  norm  of  the  Cramer  Rao  matrix,  one  may 
choose  to  maximize  some  form  of  Fisher's  information  matrix  (Reference 


o 


For  instance,  we  may  choose  to  maximize  the  trace  of  the  above  Fisher's 
information  matrix,  or  equivalently,  to  minimize  the  negative  of  its  trace. 
This  would  be  equivalent  to  maximizing  the  sensitivities  of  the  desired  pa¬ 
rameters.  The  easiest  way  to  do  this  is  to  increase  the  signal-to-noise  ratio 
of  the  measured  responses  by  increasing  the  size  of  any  given  input.  How¬ 
ever,  since  the  ncise  level  is  fixed,  increasing  the  signal-to-noise  ratio 
eventually  leads  to  the  point:  where  the  responses  become  too  large  to  control 
or  the  model  chosen  for  the  airplane  is  no  longer  valid.  In  the  example 

*  Goodwin  (Reference  70 )  has  pointed  out  th«t  they  *re  not  exactly 
equivalent. 
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using  the  preceding  suboptimal  approach  to  the  input  design  problem,  in¬ 
creasing  the  signal  ievel  was  essentially  all  that  was  accomplisned.  With 
that  method,  a  final  input  had  to  be  made  up  from  a  given  set  of  bare  vector 
inputs,  and  the  shape  of  the  final  input  is  not  altered  significantly.  When  the 
optimal  approach  is  taken,  however,  the  final  input  does  not  depend  on  any 
prv-'en  base  vector  of  inputs,  and  does  change  the  shape  of  the  initial  input. 


The  optimal  approach  ic  Dasically  a  solution  to  a  two-point  boundary 
value  problem  using  the  conjugate  gradient  method  to  update  the  initial  input 
(Reference  72).  In  this  method  we  wish  to  minimise  the  performance  index 

J  : 


J  j * 


(F.  11) 


The  first,  terms  above  are  the  negative  of  the  trace  of  the  Fisher  information 
matrix,  and  the  last  term  is  a  penalty  function  of  the  state  vector  X,  which 
is  added  to  keep  the  responses  of  the  airplane  within  reasonable  bounds.  C 
is  an  inputted  constant  which  determines  the  weight  given  to  the  penalty 
function.  The  system  is: 


(F.  12) 

(F.  13a) 
(F.  13b) 
(F.  13c) 
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f 


o  o 
F  0 

o  f 


o 


{F.  13d) 


(F.  13e) 


*  4xJ  state  vector 

xn  -  2x1  control  vector 

F  4x4  stability  derivative  matrix 

0  4x2  control  matrix 

S-  4x1  sensitivity  vector  of  parameter,  o  =  1,2,  ••.9 

-ft >•  -  parameter  of  interest,  L  -  1,2, .  .  .  q 


Define  the  Hamiltonian  H, 


3  *  *  k  **  *  *  %rce'W 


(F.  14) 


where 


or 


u„.  -  S 


a 


at 


-f 


e1 


*  ^ 


.r 


^  (*/)- 0 


(F.  15) 
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The  gradient  is 


(F-16) 

To  update  the  control,  yr)(i),  the  standard  conjugate  grr  iient  method 
is  used:  (  *  =  t  :ration  no.) 


it)  =  (*)-  it) 

(F.17) 

(t)  -  Q,  (*) 

a-i  (*)  *  (*)  *  4-,  ai-t  (/)  1  * 1 

(F.  18) 

&  /'[h  v}1# 

(F.  19) 

C  [*-><$  ** 

(F.  20) 

In  the  iteration  scheme  the  control,  m(i)  ,  is  also  bounded  at  chosen  values, 
so  the  inr will  not  become  unrealistic. 


The  procedure  is  to  first  initialize  the  control  input,  then  evaluate 
\  Ct)  by  integrating  (F.  12)  forward  in  time.  Next,  &(t)  is  evaluated  by 
integrating  (F.  15)  backward  iri  time  from  tf  .  Now  g(t)  is  evaluated  from 
(F.  16)  and  m(t)  is  updated  by  (F.  17)-(F.20).  I  is  calculated  and  the 
iteration  is  stopped  if  it  has  reached  a  minimum*,  if  not,  the  procedure  is 
repealed  by  evaluating  Va(t)  with  the  new  wCD. 

For  a  preliminary  look  at  this  method  it  was  decided  to  use  a  linear 
model  of  the  X-22  with  just  <5^s  com rol,  and  to  maximize  the  sensitivities 
of  Mu  ,  Myf  ,  ,  and  .  This  reduces  the  size  of  information  matrix 

down  to  a  4  x  4  matrix. 

Figure  F-l  shows  a  computer  run  which  utilized  the  following  param¬ 
eters. 
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a 


10,000 


?.o  o  o 

0  10, 000  0 

0  0  4oo,  ooo 

At  *0.1,  £  =  6  sec  9  7 7)(i)s  ^  (tj 

and  the  F  and  G  are  the  same  as  the  preceding  example.  The  initial  control 
perturbation  was  A  =  0.  12  inch.  Notice  that  the  initial  and  final  signal 
i.o  noise  ratios  _ 

/  Se-'xdt 

0 

were  approximately  the  same,  but  that  the  sensitivities  of  the  parameters 
were  doubled.  It  is  interesting  to  note  that  the  control  reversing  occurred 
at  approximately  1.5  seconds  which  is  about  one>half  period  of  the  oscillatory 
mode  of  the  X>22 A  at  this  flight  condition. 

Concluding  Remarks 

As  a  result  of  our  studies  on  input  design  discussed  in  this  Appendix, 
the  following  remarks  are  in  order: 

(i)  Sensitivity  of  the  aircraft  motion  to  parameter  variation 
is  a  good  criterion  for  the  input  design.  An  increase  in 
sensitivity  results  in  an  increase  in  parameter  iden- 
tifiability. 

(ii)  Input  design  using  the  exact  optimization  technique  is  not 
practical  for  all  the  parameters  simultaneously;  however, 
suboptimal  techniques  appear  to  be  feasible  by  grouping 
the  parameters  into  several  groups  with  a  smaller  number 
of  parameters  in  each  group  for  sequential  parameter 
identification.  Also,  cut-and-try  methods  based  on 

past  experience  and  using  sensitivity  as  the  criteria  have 
been  demonstrated  to  be  practical. 
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1  Signal  to  noise  ratio  of  response  stays  approximately  the  same 

2  Sensitivities  doubled  (i. e.  ,  the  variance  of  the  identified  parameter 


would  ce  one  half) 


Figure  F-l  State  Responses  to  Designed  Input 
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TABLE  F-2 

EFFECTS  OF  INPUT  ON  KALMAN  FILTERING  * 


r 


PARAMETER 

TRUE 

PARAMETER 

VALUES 

1-D  DATA:  MODERATE 
MEASUREMENT  AND 

PROCESS  NOISE 

OLD 

INPUT** 

NEW 

INPUT* 

% 

-.0044 

-.00424 

-.00454 

*w 

-.0075 

-.00847 

-.00749 

-.6250 

-.32170 

-.74280 

MS'S 

.4800 

.49670 

.52260 

*u 

-.1500 

-.19650 

-.15420 

Xis 

.0210 

-.02290 

.01495 

X$as 

1.3710 

.61270 

1.68330 

%iL 

-.2160 

-.16160 

-.19710 

i« 

-.6500 

-.59160 

-.61060 

1.6600 

4.73220 

1.07400 

*  Without  Accel.  Measurements 

**  Old  Input  New  Input 


M*s 

0.1  “ 

ot 

1  time  (sec) 

'a  to 


A$eg 

0  i' 

o.t 

0 

10 

r 

-o.3‘ 


-time  (sec) 
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TABLE  F-3  A  Sample  Run  of  Suboptimai  Input  Design 


Time  -  Seconds 
1  2  3  4 


w 


Final  4  Mode  Output 
-f  inal  8  Mode  Output 

Initial  Input 
Trim 


4  Mode  Case 
B0  *  (.1,0, 0,0) 

Sf  -  (-179 .  .128,  .0065,  .0043) 


0  -1.44  -.096 


$e^8eA** 


%  *  (*> 

8  Mode  Case 

®c  *  (-1,0,0,  0,  •  •  •  t  O) 

-  (.  213, 4)33,  .0068,  .0018,  -09/9,  .019,  .014,  -.0336) 


p.f  0 

0 

0 

0 

0  -1 

0 

0 

0 

0  0 

0 

1 

0 

0  0 

-144 

-.096 

0 

TABLE  F-3 

A  SAMPLE  RUN  OF  SUBOPTIMAL  INPUT  DESIGN  (CONTINUED) 
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APPENDIX  G 


MATHEMATICAL  PRELIMINARIES 


In  this  appendix,  several  pertinent  properties  of  Gaussian  random 
variables  are  first  discussed.  The  importance  of  the  conditional  expectation 
to  parameter  estimation  is  then  stressed.  Finally,  some  useful  properties 
and  formulae  for  Gaussian  conditional  expectation  and  covariance  are  given. 
These  formulae  are  necessary  for  the  development  of  locally  iterated  filter- 
smoother  and  fixed-point  smoothing  algorithms. 


Some  Properties  of  Joint  Gaussian  Random  Variables 


Let  K  be  a  random  vector  of  n-variables  ^  ,  t.  si,  Z,  .....  . 

The  random  variables  %t  are  said  to  be  jointly  normal  if  their  joint  density 
function  4 (%)  =  f(t,  r2...%n)  is 

m --  ^  r *'i}]  (o.  i) 

where  the  mean  v  and  the  covariance  matrix  are  defined  by 


*  *  £(*)  =  £ 

'  '  h*  $ 
_  1 

1 - 

fcf*. . 

1 _ _ 

1 

** 

i _ 

- , 

i 

*  »  (*f '*,)(**'"**) 

?  V-rt) 


(G.  2a) 


<G.  2b) 


Note 


B  is  the  expectation  operator  and  \P^  |  is  the  determinant  of 
that  the  density  function  f(%)  in  (G.  1)  is  characterised  by  only  two  param¬ 
eters,  the  mean  x  and  the  covariance  matrix  .  For  this  reason,  it  is 

of  symbolic  simplicity  to  express  the  sensity  function  (G.  1)  as 

(G.  3) 


Consider  next  the  random  vector  u,  -  (vT ,  y7  )T  where  X  is  a  n-vector 
and  y  is  m-vector.  Assume  that  x  and  y  are  jointly  normal.  Then 


where  by  definition 


t(u)=  */(u,  Pau) 


(G.4) 


(G.  5a) 


(G.  5b) 


It  is  easy  to  establish  the  the  following  important  properties  of  the  joint 
Gaussian  random  variables. 


(i)  A  linear  transformation  of  Gaussian  random  variables 
yields  Gaussian  random  variables.  For  example,  let 
ur  ■=■  T u,  ,  where  T  is  a  linear  transformation.  Then 

Uur)  =  N(TuyTPuT') 

(ii)  Let  x,  y  be  jointly  normal.  If  x  and  y  are 
uncorrelated,  then  x  and  y  are  independent.  This 
fact  is  readily  seen  from  (G.  1),  (G.4),  and  (G.5). 

(iii)  If  x,  y  are  jointly  normal  with  joint  density  function 

(G.4),  then  x  and  y  are  both  marginally  normal 
with  marginal  density  functions  {fa)  ‘ 

respectively.  To  show  that  x  is  normal  one  simply 
chooses  the  transformation  T  to  be 
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I 


(G.  11c) 


If  x,  y  are  individually  unccr related  with  z,  then  x 
and  y  are  jointly  independent  of  z.  This  is  easily 
seen  from  (G.  5b)  and  (G.  11c). 


These  important  properties  will  be  utilized  to  ef  u.blish  some  useful  pro¬ 
perties  of  Gaussian  conditional  expectation  and  conditional  covariance  later. 
The  importance  of  the  conditional  expectation  is  discussed  in  the  next  section. 

Fundamental  Theorems  of  Estimation 
Problem  Statement 

The  general  estimation  problem  can  be  formulated  as  follows: 
Let  x  be  the  state  vector  (which  may  include  the  unknown  parameters)  to  be 
estimated.  A  set  of  measurements  <ff ,  . ..  ,  yM  is  made  which  are  related 

to  the  state  by 

Hl  1 1%)  ,  i '»  UZy  .  ..  (G.  12) 

where 

is  the  measurement  vector,  an  m-vector 
is  the  state  vector,  an  n-vector 
V-  is  the  noise  vector,  an  m-vector 

The  problem  is  to  estimate  1 based  on  the  observation 
Y(n)  ^  (y,r,  ^  ,  . . .  ,  tjj  )  T,  n  £*  Depending  on  whether  H>v,  «■  z», 
or  i.  <  V ,  the  problem  is  said  to  be  of  prediction,  of  filtering,  or  of  smooth¬ 
ing  respectively. 
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Criteria  of  Estimation 


Denote  an  estimate 
sursments  Y(v),  1±.r>*N ,  K 
V (7-)  ,  i.e.. 


.  Since  there  is  available  only  a  set  of  mea- 
must  be  of  some  function  of  the  observation 


Hfn  '  f(ym) 


(G.  13) 


If  F  is  a  linear  function  of  Y (v) ,  it  is  called  a  linear  estimator  of  . 


Regardless  of  whether  it  is  linear  or  nonlinear,  an  estimator  depends 
on  the  criterion  used  for  the  estimation.  The  criteria  of  estimation  may  be 
divided  into  two  major  groups:  Bayesian  and  non -Bayesian.  Bayesian 
criteria  stem  from  the  Bayesian  estimation  philosophy  which  assumes  that 
the  entire  information  available  to  an  estimator  is  contained  in  the 
a  posteriori  density  function  )  .  On  the  other  hand,  the  non- 

Bayesian  criteria  are  based  on  the  likelihood  function  .'oge  f  . 

Merits  or  debits  cf  ti.s  Bayesian  and  non-Bavesian  criteria  are  long  standing 
problems  in  statistics.  Discussions  on  these  are  beyond  the  scope  of  this 
report.  The  approach  we  shall  take  here  is  Bayesian.  Consider  the  esti¬ 
mation  error 


(G.  14) 

Since  is  a  random  vector  (some  function  of  random  vector  YM  ), 

is  also  a  random  vector.  Thus,  the  ideal  situation  that  sO  cannot  be  met. 
Rather,  we  use  some  criteria  which  are  average  values  of  some  scalar 
functions  of  .  For  instance,  consider  a  commonly  used  mean  square 

error  criterion 


L-1 


A 


(G.  15) 


i.e.,  we  want  to  estimate  the  random  vector  by  a  suitable  function 
of  Y(r>)  so  that  the  mean  square  estimation  error 


CO  CO 


(G.  16) 


-«  - 00 
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is  minimum.  We  shall  see  later  that  the  mean  square  error  criterion  is  only 
a  special  case  of  a  broader  criterion  called  an  admissible  function.  (*-4) 

is  said  to  be  an  admissible  function,  if: 

A/ 

<i)  \  is  a  scalar  function  of 

(iil  (0)  =  0 

(iii)  (%*)  *  whenever  p(#±)  */>(*.£) 

where  J)  is  a  scalar  valued,  non-negative,  convex 
function  of 

<iv)  Laih)  =  L*  ('**■) 

Note  that  L  as  defined  in  (iii)  need  not  be  a  convex  function.  Some  examples 
A 

of  are  rj  picted  in  the  following  figure. 

Hh) 


Clearly,  Lf  is  a  member  of 

Some  Important  Theorems  of  Estimation 

Three  important  theorems  are  given  in  the  following.  These  are  the 
basis  for  our  subsequent  development. 

Theorem  1:  The  conditional  mean  E  is  the  optimal  esti¬ 

mator  for  the  criterion  function  Lf  in  (G.  15)  for  any 
conditional  density  function 

This  theorem  is  very  easy  to  establish;  one  simply  substitutes 

,  YM)  -  SfajYMjffYto) 


*(*4) 


\ 


*Jb 


L 
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into  (G.  16),  yielding 


From  this  equation,  it  is  readily  seen  that  ^jY(n)j  minimizes  the 

second  integral,  and  hence,  since  the  integral  above  is  non-negative,  the 
criterion  function  .  In  the  above  theorem,  the  criterion  function  L1  can 
be  relaxed  considerably  at  the  expense  of  imposing  some  constraints  on  the 
conditional  density  functions.  Shereman  (Reference  42)  has  established  the 
following  important  theorem. 

Theorem  2:  If  the  conditional  density  is  symmetrical  and 

unimodal.  then  the  conc-itional  mean  is  the  optimal 

estimate  for  all  the  admissible  criteria  functions  . 

a. 

The  importance  of  theorems  1  and  2  is  further  enhanced  by  the  fact  that  the 
conditional  mean  is  an  efficient  estimator,  i.e.,  the  conditional  mean  is 
unbiased  and  minimum  variance.  Indeed,  it  is  easy  to  establish  (Reference 
31): 

Theorem  3:  The  conditional  mean  is  an  efficient  estimator  (i.e., 

unbiased  and  minimum  variance). 

We  see  from  theorems  1-3  that  the  conditional  mean  is  a  very 
desirable  estimator.  In  order  to  obtain  the  estimate,  one  has  tc  first  obtain 
the  conditional  density  function.  However,  as  we  shall  see  later,  the  avail¬ 
ability  of  the  conditional  density  function  is  often  one  thing,  but  the  evaluation 
of  its  mean  is  quite  another,  and  this  difficulty  is  often  encountered  in  non¬ 
linear  problems. 

It  is  also  appropriate  here  to  point  out  chat  if  the  conditional  density 
function  /  (^jYCnjj  *-8  symmetric  and  unimodal,  then  its  mean  and  mode 
coincide.  The  conditional  mode  is  closely  related  to  the  weighted  least 
square  criteria  as  discussed  in  Section  III. 


291 


The  importance  of  the  Gaussian  case  will  now  be  discussed.  Clearly 
a  normal  density  function  is  symmetrical  and  unimodal.  Thus,  if  %, ^  and 
YM  are  jointly  normal  we  see  from  (G.8)  and  (G.9)  that  is  also 

normal.  Thus,  tne  conditional  mean  =  E[t^jVCn))  is  the  optimal  esti¬ 
mate  for  all  the  admissible  criteria  functions  L 4  .  Furthermore,  we  also 
see  from  (G.9a)  that  this  estimate  is  a  linear  function  of  the  available 

data  YM  .  Thus,  for  the  Gaussian  case,  the  conditional  mean  is  a  linear 
estimator.  Further,  it  is  optimum  with  respect  to  all  the  admissible  criteria 

Before  we  proceed  to  use  these  theorems  to  develop  our  filter- 
smoother  algorithms,  we  shall  first  present  some  useful  formulae  pertinent 
to  the  Gaussian  conditional  mean  and  covariance  in  the  next  section. 

Some  Useful  Formulae  for  Gaussian  Conditional  Expectation 
and  Conditional  Covariance 


From  the  fundamental  theorems  of  estimation  discussed  in  the  pre¬ 
ceding  section,  we  see  that  the  conditional  expectation  is  of  paramount 
importance  in  our  subsequent  development  of  the  estimation  algorithms.  We 
will  see  later  that  the  conditional  covariance  is  also  an  important  parameter 
for  assessing  the  quality  of  the  estimate.  For  use  in  subsequent  develop¬ 
ments  we  present  here  several  useful  properties  and  formulae  for  Gaussian 
conditional  expectation  and  conditional  covariance, 

(i)  The  conditional  expectation  of  x  given  y,  is  a 

Gaussian  random  vector  which  is  a  linear  function  of  y. 
This  is  readily  seen  from  (G.  9a). 

(ii)  The  random  vector  v  =  *  -  E(%\y)  is  independent  of 
any  linear  transformation  of  y.  Since  the  random  vector 
%-E(xjij)  has  a  zero  mean  (this  is  easy  to  see,  since 
E^Efejtf) J  =  E(x)  ),  the  above  statement  implies  that  the 
random  vector  x,  which  is  the  estimate  error  of  x 
given  y,  is  orthogonal  to  any  linear  transformation  of  y. 
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This  is  one  of  the  most  important  properties  of  the 
minimum  mean  square  estimation. 


(iii) 


Let  x,  y,  and  y  ’ue  jointly  normal  with  joint  density 
function  as  given  by  (G.  10).  Then  the  covariance  of  x, 
y  given  y  is 

-  &{[*'£  [tj  -  B  G/f)]r} 

indicating  that  the  condition  on  y  can  be  removed. 

Furthermore, 

PM/*  *  [y'EW]r} 

(G.  19) 


(G.  18) 


where 


*  P*9  -  p4 

5  -  y-zfol}) 

%  (k 


Equation  (G.  18)  is  an  immediate  consequence  of  the  pro¬ 
perty  (ii)  and  the  property  (v)  discussed  in  Gaussian 
variables.  (G.  19)  is  obtained  using  the  property  (  ii), 
equation  (G.  9a)  and  the  fact  that  E(tj)  *£.(%)  *0. 


(iv) 


Let  x,  y,  and  y  be  jointly  normal  with  density  function 
as  given  by  (G.  10)  (  with  y  replaced  by  y  ).  If  y  and 
y  are  independent,  then 


(G.  20) 


This  relationship  can  be  easily  obtained  from  (G.  9a)  and 
the  fact  that  P^g  -  *0- 


(v)  Using  (G.  14)  it  can  be  shown  in  a  straightforward  manner 
that 
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(G.  21) 


£(*Im)  *  £(*ly>%) 


where  „  c/  \ 

Note  that  y  and  ^  are  not  independent.  By  interchanging 
y  and  ^  it  is  readily  seen  from  (G.  18)  and  (G.  19)  that 


and 


Thus  {  O.  21)  can  also  be  expressed  as 


B [‘X’lwY  P%>^y  P'ffo  (y£ tyf))  <G- 2 la> 


(Vi) 


From  (G.  9b),  (G.  21)  and  (G.  21a),  it  is  straightforward 
to  establish  the  following  important  results  of  the  con¬ 
ditional  covariance  of  x  given  y  and  ^  . 


where 


p*h 


-p  ~  pzL 


p 


(G.  22) 


or 


(G.  22a) 


The  formulae  (G.  21),  (G.21a),  (G.  22),  and  (G.  22a)  are  of  fundamental  im¬ 
portance  in  the  recursive  estimation  of  parameters.  One  may  interpret  x 
as  the  parameter  to  be  estimated;  and  y  and  ^  are  respectively  old  and 
new  data.  Thus  (G.  21)  indicates  that  the  optimal  estimates  of  the  parameter 
x  given  all  the  data  is  a  linear  combination  of  the  old  estimate  and  new  data, 
if  x,  y,  ^  are  jointly  distributed  normally. 


The  results  of  this  Appendix  are  used  to  develop  filter -smoother 
algorithms  in  Section  5.2. 
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APPENDIX  H 


ACTUAL  BIAS  AND  COVARIANCE  IN  MULTI-CORRECTED 
EXTENDED  KALMAN  FILTER 


Consider  the  dynamic  system 

where  the  random  vector  sequences  and  are  white  Gaussian  with  aero 
mean  and  covariance  matrices. 

h, 

E(W)  -  2t  h, 

E(vt<sr) ,  0 

Assume  that  the  nonlinear  functions  and  h £  may  be  adequately  represented 

by  a  two-term  Taylor  series  expansion 

h(%)»  h(%)  *y%  (*•*)  *j  :  [(*-*X*-*)r] 

where  J  \ix-f)(x-^)r  J  is  a  vector  whose  Ith  element  is 

and  *1  £  *2.1  etc. 

**  dx jf 

It  is  known  that  the  extended  Kalman  filter  (5.  32)  is  a  biased  estimator.  To 

A 

show  this,  let  >„■»  begin  with  an  unbiased  estimate  with  covariance 

rm'riX  1  I''- 


(H.  2a) 
(H.  2b) 


cor 


1 \-mJ 


p*-f 


and  define 


Sfr-/  -  V 45 


W*- 


(H.  4a) 
(H.  4b) 
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T  Ua«  o  - r - - -»■> 

*  x-LWJAt  iXClClCllLC  J  u 


[  e4.}i.-t  ]  "  2  :  P-£-l 


r*  1 

cov  e.i.  .  ! 


*/*-/*  =  §±lt-ipi.i  4 ”  **/*.-/ 


(H.  5a) 


(H.  5b) 


E  [e^  ]  ( J"  [®^-/]  ~  2%.  h%9  *'  {£^/i-/  e4/£-/)} 


(H.  5c) 


(H.  5d) 


showing  that  the  extended  Kalman  filter  gives  biased  estimates.  However, 
the  computed  covariances  are  identical  to  the  actual  covariances  approximated 

to  the  second  order.  We  note  in  (H.5)  a  =  o  I  .  A  £  li  _| 

iH-tfe-t  >*ifc [£-f 

We  wish  to  examine  the  bias  at  the  second  correction.  To  this  end, 
we  first  consider  the  one  state  smoothing  (5.  38).  Define 

/*  A 

^  /  , !  L.  =  ^  J  .  I  y 


then  from 


=  ~  V/fe 

(5.  38)  and  the  fact  that  (I - *  -^4-/  ^  ' 


**-//*  P*-1  §£,i-t  P*j£-t  \  (^*^4  e£jl-f  *  Z  ^*x:[e£l£  fe£j£-f]  J 


(H.6) 


and  hence 


J  «*-,/*]  • ' - 1,  K,t:  P^t;  «4  (Ht£[  V']'  (fyf)  E  f  ^-4 


F  rom  (H.  6)  and  (H.  7)  we  have 


(H.  7) 


'  *£-/  P£ji-f  %{%*%[  e£j-L-i  ~E(*£jk-t) ] 


(H.8) 
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Thus, 


r 


fiC' 


“  £{[^i-tk-r  P*-I Ptll-I  A {'i ' H* (e^., '£ ))J j 

'  [  W-'  A  {va  hk.,-^4}  rl 

*  higher  order  terms 

K,i;  A^£l ««/<-/ 

+  higher  order  terms 


(H.  9) 


It  is  easy  to  see  that  to  second-order  approximation 

»  $  p. 

*4  4-1 

Similarly  E[^ 

Hence  to  the  second-order  approximation  th»  ~  ,  __ 

hh-  imauon  tne  actual  covariance  matrix  for  the 

one-stage  smoothed  estimate  is 


(H.  10) 
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(H.  11) 


"P*.,-Pi-,  K.i-,  hi-’  Pi-> 

-pi-’hi-<  %■>  fPi-&.*-’P4i-<  *i 

>Kp*t*A r.'ei)tipJi.f  h  p* 


which  is  identical  to  the  computed  covariance  for  the  one-stage  smoothed 
estimate  (5.  37). 


To  see  the  error  statistics  of  the  second  corrected  estimate,  we 
first  consider  those  of  the  second  extrapolated  estimate.  Define 

a  cx) 


a 

e-ejv.-1 


$. 


(2> 


r  a  a)  a  (o 


'] 


ijt-t  *  x  *,*  :  e*-;/* 

to  the  second-order  approximation.  In  (H.  12),  =  <|>  • .  ), 

'0)  a  a  a(«  a  ^  *' 1  *  '  1 

**-//*  -  V/|£  *and  e*-/{*  *  e±-ijt  •  Hence: 


(H.  12) 


(H.  13) 


96 


1  a  :  p(0  , 

2  it-//*. 

to  the  second-order  approximation. 

Thus,  to  the  second-order  approximation  the  actual  covariance  of  the  second 
prediction  is 

which  is  the  same  as  the  computed  value.  Now  consider  the  second  corrected 
estimate 

a  (z)  a  (i)  ,  tz)  j"  ,  ia.0)  \  ./  !a  it)  \/aU)  \1 

**/«.  -  \t.,<  Wh*.  (*ne)«*iii)Kii.r **/] 
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Define 


Define  a  m  a  v 

Then  to  the  second-order  approximation 


_  fr  2  lt}  1  .  I*  (t)  rl  (2>  ^ 

c^-lx-4  £  WLc*Me*/*  J-4  *a 


Hence, 


(H.  15) 


£[4'»]  -  (H.16! 

and,  to  the  second-order  approximation,  the  actual  covariance  for  is 

=  (l-C'Jt>ff<teA°>r  (H.  17) 

which  is  the  same  as  confuted  covariance  matrix  for  the  second  corrected 
estimate. 


Now,  we  are  in  a  position  to  compare  the  bias  and  variance  of  the 
first  and  second  corrected  estimates,  based  on  equations  (H.  5c),  (H.  5d), 
(H.  16),  and  (H.  17).  Assume  that  $?.  ,  *  and  H?  *  Hj.2) , 

(I)  ,  ,  *<**'  1b,£-f  t  *  ’ 

which  implies  that  ^  »  P-ftjt-i  and  '  T**en  *rom  (H.  i?)  and 

(H.  5d)  it  is  seen  that  the  variance  of  the  first  corrected  estimate  (from  the 
extended  Kalman  filter)  is  approximately  the  same  as  that  of  the  second 
corrected  estimate.  However,  the  bias  of  the  second  corrected  estimate  is 
substantially  different  from  that  of  the  first  corrected  estimate  as  evident 
from  (H.  5a),  (H.  5c),  (H.  13),  and  (H.  16).  Indeed, 

E[**(-t-i]  *  Z  9**  1  !*-t  and  m  z9Xx  :  P4-i)-t 

Since  *3  t^ie  covariance  of  the  one-stage  smoothed  estimate  which 

is  "smaller"  than  we  see  that  the  effect  of  nonlinearity  of 

the  system  is  reduced  by  the  multi-correction. 

Similarly,  noting  that  the  last  terms  in  (H.  5c)  and  (H.  16)  are 
E  [  &*f£-r  e-, t\4-t\  **  tyt-r 

t-l  A  (H  a  O) T  1  n") 

J “  p*ti 
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to  the  second-order  approximation,  we  see  that  the  effect  of  the  nonlinearity 
in  the  measurement  system  is  also  reduced. 
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APPENDIX  I 

CORRELATED  PROCESS  AND  MEASUREMENT  NOISE 


In  the  derivation  of  the  locally  iterated  filter -smoother  algorithm, 
it  was  explicitly  assumed  that  the  process  and  measurement  noise  vector 
sequences  were  uncorrelated.  With  the  incorporation  of  acceleration  mea¬ 
surements  into  the  measurement  system,  a  direct  correlation  exists  be¬ 
tween  the  resulting  measurement  noise  and  process  noise.  This  fact  can 
readily  be  seen  by  considering  the  nonlinear  dynamic  system 


i  =  f  (x,t)  -hur(t)  (I.  1) 

and  discrete  time  noise  measurements  of  both  states,  x,  and  state  deriva- 


*i 

+ 

*i . 

4 

(1.2) 

from  which  estimates  are  to  be  based  where  %(t>)  4  x^  ,  ur(t^)  ~  ur- 

for  t-  <=.  t  ,  and  V'f  and  ur.  are  zero  mean  white  Gaussian  sequences 

with 


urL 


[*fV]  I- 


(1.3) 


Qi  o 

L  o 

As  in  Section  5.2,  we  express  the  nonlinear  system  (I.  1)  in  discrete 


form  as 


*i  =  +'i 


(1-4) 


where  g in  (1.4)  is  defined  to  be  the  solution,  at  time  tt-  ,  to 
(I.  1)  with  initial  condition  Z;.f  and  and  /"][•  is  an  appro¬ 

priate  noise  effectiveness  matrix  for  this  discrete  representation.  From 
(I.  1)  and  (I.  2),  the  measurement  system  can  be  expressed  as  a  function  of  %• 
only  or 


_ 

+ 

i  i 

i 

_ i 

.  *i). 

L  vzi  *  J 

(1.5) 
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Clearly,  ur±  and  in  (1.4)  and  (I.  5)  are  correlated,  with 

eh<0T}'  -  °i *ij- 1  > 

thus  verifying  the  previous  assertion. 


U.6) 


However,  by  a  proper  transformation,  the  process  and  measurement 
noise  can  be  made  uncorrelated.  From  (I.  5),  since 

(I.  3)  can  be  equivalently  written  as 


or 


where 


*/  =  9i  (V/M  K  (*<-, 


a).  -  r7.  u)‘  -  D.  ,  IT. 

t  it-  i-f  t-f 


It  is  desired  to  adjust  D  such  that 


or 


(1.7) 

(1.8) 

(1.9) 


£{(riK  -pi-r  n-i)  «f-,J =riar  pi->  v:-t  (t- 

From  (I.  10)  it  is  clearly  seen  that  ar«d  will  be  uncorrelated 


-  i 


(1.11) 


We  note,  from  (1, 9)  and  (I.  11),  that  «  /T  (ty-C;  2jff  d^r)P.  r&- ■ . 


Therefore,  with  D t-  given  by  (I- II)  and  noting  that  the  measure¬ 
ments  can  be  considered  as  deterministic  (known)  inputs  to  the  system 
described  by  (1.9),  the  locally  iterated  filter -smoother  and  fixed-point 
smoothex*  algorithms  are  directly  applicable  to  the  models.  (I.  5)  and  (1.8). 
The  results  are  summarized  below. 
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Locally  Iterated  Filter -Smoother. 


The  iteration  scheme  starts  with  j  =  1  and  terminates  when 

“  il!'n 

il*  A  a) 

or  after  a  prespecified  number  of  iterations.  The  converged  values  of  #^/ 
and  ^  are  taken  as  the  estimates  and  the 

covariance  P;  ,  respectively,  for  the  next  data  point. 


Fixed-Point  Smoother: 

*  *  -  .,Mr  _  ,(f) 


where 


+3. 4  ur  e;  kes- 

O/l't  0\l  L  +  1  tf-1  1*1  1  +  1 

s ,  nt»] r  s  „P 

**i  i  {_*  ^t*i  \*i J  i  o  • 


All  symbology  is  as  previously  defined  and  the  superscript^)  implies 
the  final  trajectory  in  the  locally  iterated  filter-smoother. 


A  few  general  comments  can  be  made  about  the  estimation  algorithms 
when  correlation  between  die  process  noise  and  measurement  noise  sequences 
exists  and  this  correlation  is  incorporated  into  the  algorithms. 

1.  The  algorithms  for  the  locally  ite  rated  filter -smoother 
become  slightly  more  complicated  by  tht  introduction  of 
additional  terms  in  each  of  the  matrix  equations. 

Z.  An  added  nonlinearity,  A/  (*i)  ,  is  introduced  into  the 
system  dynamics. 

3.  The  estimation  of  the  unknown  forcing  function,  u £  , 
employing  the  redefined  system  equation  (1.8),  will 
consist  of  both  the  original  process  noise  sequence  (  or-  ) 
and  the  measurement  noise  sequence  (  tr  )  as  defined 

in  (I.  9). 

4.  If  <3/  is  about  the  same  order  of  magnitude  as  Qc  and'#/, 
mr^eased  accuracy  could  be  expected. 
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However,  C;  was  set  equal  to  zero  in  the  locally  iterated  filter- smoother 
for  computational  simplicity. 


APPENDIX  J 


EFFECTS  OF  CALIBRATION  ERRORS  AND  SENSOR /FILTER  DYNAMICS 

In  the  development  of  the  identification  techniques,  consistent  errors 
in  flight  test  data  have  not  been  considered.  Three  major  types  of  consistent 
errors  exist;  sensor  offsets,  errors  in  calibration  constants,  and  sensor/ 
filter  lags  introduced  by  the  recording  system.  Di  Franco  (Reference  10) 
has  shown  that  for  the  equations -of-motion  estimator,  consistent  calibration 
slope  errors  bias  the  extracted  parameters  but  consistent  instrument  offsets 
can  be  removed  by  the  addition  of  constant  bias  terms  in  the  model  equations. 
Similar  degradation  in  parameter  identification  results  for  the  iterative  tech¬ 
niques  used  in  the  second  and  third  stage  refining  process.  Since  at  the  time 
of  this  analysis,  the  extended  Kalman  filter  was  emerging  as  the  best  tech¬ 
nique  for  use  in  the  second  stage  and  is  an  obvious  requirement  for  the  third 
stage,  it  was  considered  appropriate  to  conduct  an  error  or  sensitivity  analysis 
around  this  technique.  The  primary  goal  of  this  analysis  was  io  evaluate  the 
effects  of  sensor  and  fitter  dynamics  on  the  quality  of  the  parameters  identified 
employing  the  extended  Kalman  filter. 

Two  approaches  were  initially  taken:  (1)  numerical  experiments 
were  conducted  in  which  data  were  generated  from  a  realistic  model  formu¬ 
lated  using  noise  levels  from  the  X-22A  MPE  II  flight  test  data  and  the  sensor/ 
fi’ter  characteristics  of  the  X-22A.  Data  sets  were  generated  with  and  without 
sensor/filter  dynamics.  Both  sets  of  -lata  were  then  applied  to  the  extended 
Kalman  identification  technique  without  modification  and  the  resulting  param¬ 
eters  estimated  were  compared;  (2)  a  sensitivity  analysis  was  initiated  to 
determine  the  effects  of  erroneous  models  on  the  covariance  of  the  estima¬ 
tion  error  from  the  Kalman  filter.  If  modeling  errors  (e.  g. ,  unmodeled 
sensor  lags  and  biases  errors)  and  imperfect  knowledge  of  the  plant  mea¬ 
surement  noise  covariances  exist,  the  calculated  error  covariance  matrix 
in  the  filtering  algorithm  no  longer  represents  the  actual  error  covariance 
matrix.  Since  the  actual  covariance  matri>  of  the  estin»ation  error  .  ives 
an  indication  of  the  error  which  can  occur  v-  er-  an  incorrect  model  is  used, 
this  covariance  matrix  will  indicate  filter  performance  degradation  due  to 
inaccuracy  in  modeling. 


A  brief  summary  of  the  results  and  conclusions  from  the  numerical 
experiments  are  discussed  below.  A  derivation  of  the  recursive  matrix  equa 
tions  for  an  error  or  sensitivity  analysis  of  the  Kalman  filtering  algorithm  is 
given  in  Appendix  K. 

Numerical  Results 


To  determine  the  effects  of  neglected  sensor/fiiter  lags  in  the  X-22A 
instrumentation  on  the  Kalman  filter  identification  technique,  three  sets  of 
data  were  generated  on  the  computer  employing  the  linear  equations  of  motion 
of  the  X-22A  at  fixed-duct  incidence.  Data  generation  is  hown  pictorially 
in  Table  J-l  for  each  case,  and  noise  characteristics,  sensor/filter  dynamics 
used,  trim  conditions  and  control  input  are  given  in  TaLle  J-2. 

An  investigation  of  the  X-22A  instrumentation  revealed  that  the 
models  included  three  of  four  sources  of  possible  error.  These  are: 

1.  Sensor/filter  dynamics 

2.  Individual  channel  filter  dynamics 

3.  Colored  measurement  noise 

£ 

4.  Consistent  bias  and  calibration  slope  errors 

Values  of  each  error  source  are  given  in  Table  J-2.  These  values  were  esti¬ 
mated  using  MP £  II  flight  test  data  and  the  instrumentation  characteristics 
on  the  X-22A.  Calibration  and  bias  errors  are  considered  "maximum  worst 
case"  and  are  commensurate  with  the  existing  instrumentation  accuracy. 

Freque---/  response  characteristics  of  the  sensor/filter  combina¬ 
tions  in  all  measurement  channels,  except  u.  and  ur  ,  were  considered  to  be 
flat  to  frequencies  high  enough  to  have  negligible  effect  and  thus  were  not 
included.  Since  q  is  obtained  by  differentiating  q  in  the  X-22A,  a  differen¬ 
tiator  was  simulated  by  the  transfer  function 

v  This  source  of  error  was  not  considered 
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(J.  1) 


s(5o)Z 

(s*5o)2’ 

To  include  the  effects  of  colored  measurement  noise,  the  measurement  noise 
statistics  were  assumed  to  be  an  isotropic  zero  mean  random  process  with 
experimental  autocorrelation  function 

£  I *(i)  n,(t  =  e'8lrl  (J.2) 

where  is  the  variance  and  S  is  the  bandwidth.  Since  at  the  present  time 
the  statistical  properties  of  these  errors  (e.  g. ,  power  spectral  density)  are 
not  well  defined,  it  is  reasonable  to  adopt  the  model  specified  by  (J.2).  & 

for  each  measurement  source  was  chosen  to  be  consistent  with  the  bandwidth 
of  its  particular  sensor  and  filter. 

Data  3A  also  included  the  individual  channel  filters.  Note  that 
process  noise  was  assumed  absent. 

Results  employing  the  linear  version  of  the  extended  Kalman  filter 
without  acceleration  measurements  and  the  systematic  recycling  technique 
discussed  in  Section  V  are  given  in  Tables  J-3  through  J-6.  Tables  J-4  and 
J-5  depict  sensitivity  of  the  parameter  estimates  for  different  selections  of 
P0  .  In  all  cases,  the  Va  matrix  was  formed  from  the  equations -of- motion 
variances  multiplied  equally  by  a  constant  factor.  From  these  results,  the 
following  general  conclusions  can  be  made. 

•  The  parameter  estimates  from  the  equations -of-motion 
initial  estimator  are  "very  poor"  when  ser.sor  dynamics 
are  present.  This  degradation  is  contributed  to  by  the 
way  £  is  measured  in  the  X-22A,  i.e.,  differentiating 
and  simulated  here.  However,  the  systematic  recycling 
of  data  through  the  extended  Kalman  filter  improves 
the  estimates  considerably. 
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•  Senscr  dynamics  and  correlated  measurement  noise  (as 
defined  here)  have  "very  little"  or  no  effect  on  the  quality 
of  the  parameters  estimated  using  the  systematic  approach. 
Small  degradation  is  due  to  a  poor  initial  estimate 
because  of  the  £  measurement. 

•  Additional  filtering  of  the  responses,  assuming  all 
filters  are  the  same,  improves  identification  by  reducing 
noise  levels.  The  added  dynamics  of  the  filters,  if  the 
filter  cutoff  frequency  is  6  Hz  or  better,  does  not  affect 
the  Kalman  technique. 
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TABLE  J-l 


CONTROL 

INPUT 


Data  Generation 


CASE  2A  (NO  ERROR  MODEL  I 


RIGID  BODY 
EQUATION 


J<1) 

4 


DISCRETE 

MEASUREMENTS 


V(t)-  MEASUREMENT 
NOISE 


CASE  1A  (ERROR  MODEL.  SENSOR  OUTPUTS) 


RIGID  BODY 
EQUATION 


SEASON 

DYNAMICS 


+  At‘} 


h<*> 


NOISE 

SHAPING 

FILTERS 


CASE  3A  (ERROR  MODE’..  FILTER  OUTPUTS) 


- FILTERS  1" - — w 


RIGID  BODY 
EQUATION 

A*  o 


SENSOR 

+/t\ 

*4  FILTERS 

DYNAMICS 

T+ 

NOISE 

SHAPING 

FILTERS 


1  ■**»**»- 1 


>4 fill' 


TABLE  J -Z 


Measurement  Noise  Characteristics  and  Sensor  and  Filter  Dynamics 


MEASUREMENT  NOlSE 


SENSOR 


(2)  4 

80s 


STANDARD  1(1)  BANDWIDTH 
DEVIATION  |  SHAPING  FILTER 


2.6  fps 


.36  fps 
.09 

.2-  / J6C 

.012  g 
.05  g 
2.3  /sec 

NONE 


SENSOR 


FILTER 


^  --  6  Hz 
8  =  .707 


(3)  CALIBRATION  ERRORS 

FUNCTIONAL 

BIAS 

SLOPE  ( 3o) 

(3  0) 

.02 

1.3  fps 

.02 

.75  fps 

.01 

.12 

.015 

.25  /sec 

.005 

.005  g 

.005 

.01  g 

.015 

.“7/ sec2 

0 

0 

(1)  ESTIMATED 

(2)  NO  SENSOR  ON  X-22A 

(3)  MAX  WORST  CASE.  SET  TO  ZERO  IN  DATA  GENERATION 
(N)  DIFFERENTIATE  q  AS  INSTRUMENTED  IN  X-22A 

■TRIM  CONDITIONS 


n  0 

90  =  ° 

wQ  =  5.36  fps  6e 


=  130  fps 


•  CONTROL  INPUT  - 


TABLE  J- 3 

Summary  of  Initial  Estimator  -  Equations  of  Motion 


NO  ERROR  MODEL 

ERROR  MODEL  -  SENSOR 

ERROR  MODEL  -  FILTERED 

PARAMETER 
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2A 

1 A 

3A 

VALUE 
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NO  PROCESS 
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«ur 
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Mg 
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-.625 
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*u 
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Xur 
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*8 
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PARAMETER 


TRUE 

VALUE 


3A 


P(o)  = 


2A 


M. 

-.0044 

-.00456 

-.00507 

-.00492 

‘ u 

-.0075 

-.00753 

-00795 

-.00757 

% 

-.625 

-.7748 

-.997 

-.8936 

\s 

.48 

.5044 

.5746 

.5620 

*tc 

„  t  «r 
••  »* 

-.0877 
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V 

.021 
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K. 

-.216 
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-.5944 
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8^ 

1.66 
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i 
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APPENDIX  K 


SENSITIVITY  FUNCTIONS  FOR  THE  KALMAN  FILTER 

The  recurrence  relations  in  the  Kalman  filter  algorithm  yield  the 
correct  error  covariance  or  performance  of  the  filter  if  the  a  priori  sta¬ 
tistics  (  P  (o)  ,  R  and  Q  )  and  choice  of  the  mathematical  model  truly  rep¬ 
resent  the  actual  process.  If  this  is  not  the  case,  the  calculated  error 
covariance  no  longer  represents  the  actual  error  covariance  of  the  filter. 
Since  this  latier  covariance  matrix  gives  an  indication  of  filter  performance 
(on  the  average)  due  to  unknown  a  priori  statistics  and  modeling  errors,  it 
is  of  prime  importance  in  determining  filter  degradation  or  performance 
sensitivity  with  respect  to  variations  in  the  assumed  model. 

Matrix  difference  equations  are  briefly  derived  in  this  appendix  for 
the  actual  error  covariance  of  the  linear  discrete  filter.  Since  these  equa¬ 
tions  appear  elsewhere  in  the  literature  (References  31,  73,  and  74),  a 
detailed  derivative  is  not  given.  However,  for  the  interested  reader,  a  com¬ 
plete  development  is  given  by  Griffin  in  Reference  74.  If  the  estimation 
errors  are  small,  the  equations  are  directly  applicable  for  a  sensitivity 
analysis  of  the  extended  Kalman  filter. 

Derivation  of  Actual  Covariance  Matrices 


Assume  the  actual  or  exact  process  and  measurement  vector  is 
described  by  the  vector  difference  equation 

</*(£♦/)  •  <Pa'(*)y*(H)+r'afa)ura(£)  (dynamics) 

(K.  1) 

(it)  =  HA(£)  (/*(£)+  t/-a(lL)  (measurements) 

with  the  moments 

E[ura(L)}  =  0  E{*rafe)orar(j)J  *QA(A)2ik. 

J  J  (K.2) 

E{va(i)}  =  0  E[r*(t)v+T(j)}  =  Tf(*)84. 

e(  it*  (lb)  or"  ( / ) }  -  0 

i  '  '"J 
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where  the  superscript  "a"  refers  to  the  actual  process.  The  assumed 
model,  used  to  derive  the  filter  equation,  is  postulated  to  have  the  same 
formas  linearized  equations  (5.  13)  and  (5.  14),and  is  given  by 


*(*♦')*  +r(*)ur(t) 

ffe)  »  H(4>)  y[i)+ir(k) 

with  the  moments 


£  j  J  -o 

E(ar(i)arr(j)j 

=  Q(t)St. 

e[v( t)J  *0 

erj  v(i)  v-r(j)j 

-  e(*)Sij 

E[v'(l)*rr(j)f  -  0 


(K.4) 


In  the  sequel,  all  unsuperscripted  variables  will  refer  to  the  assumed  model 
or  calculated  covariances. 


Using  the  assumed  model  and  statistics  as  defined  in  equation  (K.  3) 
and  (K.4),  the  estimator  gain  k(t)  and  calculated  error  covariance  are 
given  by  equation  (K.5). 


K(*)  -  M(£)UT(£)  [H(4)M(£)»T(*)+e(t)] 

M(i)  =  P(t- t)  $T(it-/)+r(-i-t)Q(iL-f)rT(t-f) 

p(t)  *  [r M(t)  [i-rtifrOL)]  T+V(t)  V(£)Kr(£)  7  (K  •  5> 

P(°)  =  initial  error  covariamr 
The  estimation  equation  then  becomes 

5ft)  *  [?a(±)~H(4.)y(t)}  (K.  6/ 

where  g(e)  .  f(t;)  §(*.>) 

<)  (o)  -  £{»<yj 

Subtracting  the  estimation  vector  from  the  state  vector  of  the  actual  process 
gives  the  actual  estimation  errors.  Therefore, 
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=  yA(*)-y(*) 

(K.7) 

y  *  (*■)  =  y*(-t)-y(i) 

where  y  &  and  y  1  ,»re  the  actual  estimation  errors  given  data  up  to  and 
t-1  ,  respectively.  The  actual  covariance  of  the  estimation  er*  .  rs  tre  de¬ 
fined  as  usual  in  equation  (K.8) 

p‘«)Se{ 

1  -  ** 
ya  a)  &  b  {?  a&)§*7(£)J  (K‘ 8> 

Using  equations  {K.  1),  (K.6)  and  (K.7),  matrix  difference  equations 
for  Ma(£)  and  Pa(t)can  easily  be  shown  to  be  given  by 

Ma(t)  =  §(4-r)Pa'(£-f)§T(*’-')+£$(t-f)%  (*-f)$T(*-f) 

+na(-£-t)Qa(-£~/)rArU-r) 

(K.  8a) 

PA(t)  =  [r-A '.(4)Hw\  M*(4) [l-K{iL)H(*j\ r 

M*(i)AHT(£)K  r(£)+X(£)K*(ii)  K  T(*) 

*  k!(m  u(4)  p*  (H)  a  u  r(^K(a) 


*  This  equation  is  also  valid  when  the  actual  process  and  assumed 
model  have  different  order.  For  the  usual  case  where  the  order  of 
the  actual  process  is  greater  than  the  order  of  the  assumed  model, 
equations  (K.  3)  and  (K.6)  should  be  interpreted  as  though  fictitious 
zero  states  were  augmented  to  the  assumed  model  equations.  This 
implies  >£(&)  will  have  the  partitioned  form 

£(*)«  1 

It  is  not  strictly  correct  to  refer  to  Pa  (■£■)  as  a  covariance  matrix 
because  error  in  the  assumed  model  dynamics  could  make  £ [$*(*)}  £  0. 
However,  PaUc)  does  provide  a  direct  measure  of  the  actual 
estimation  error. 
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where 


AUM 

%<*) 


&  »*<&)- m) 

k  E[f &$*(£)} 
*  £{f  &)?*(£)} 
k  B.(ya(t)t/*r(-e)l 


with  the  initial  condition 

pA(o)  y v-^y^j] -£h*(o))j j 

and  Id  (t-J  is  generated  from  (K.  5). 


(K.  8b) 


(K.  8c) 


Similarly,  difference  equations  for  the  cross-covariance  a  nr,  auto¬ 
correlation  matrices  defined  in  (K.8b)  can  be  shown  to  be  given  by  the  follow¬ 
ing: 

Mc  (■£.)  =  § *(4 -t)-Pc(£- 1)§ T(£ - f) * $*( £-t) (£-f)A$T(-£-t) 

(K# l') 

p,  (4)  «  Mc  (-L)  [l  -  kd(t)bW]  7  -  p/  (£)APrte)  Kr(t) 

(*-0frT(*-i)+r*(*-i)QA(*-t)r*T(4-i) 


The  particular  differences  between  the  actual  process  and  assumed 
model  usually  indicate  the  initial  conditions  used  in  (K.9).  In  general,  if 
E]ya(o)J  =  o  the  initial  conditions  are  easily  shown  to  be  given  by 

Ptf<a)  (°)  s  Pc  (°)  m  P  *(*)  ( K .  1 0) 

For  the  case  where  the  assumed  model  and  actual  process  are  of  the  same 
order,  (K.  10)  holds  for  the  less  severe  condition  that  if(o)~ 

The  optimal  filter  performance,  V6  (•£)  ,  achievable  when  the 
assumed  model  correctly  characterizes  the  actual  process,  is  obviously 
given  by  (K.5),  when  the  actual  process  parameters  are  used. 
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Mean  of  Estimation  Error 


It  was  indicated  in  the  footnote  to  equation  (K.8)  that  if  modeling 
errors  exist  (A$(t)40  and  0  ),  the  mean  of  the  actual  estimation 

error  may  not  be  zero.  If  4  0  ,  the  covariance  of  the  estimation 

erroi  is  not  Pa(£)  but  is  more  correctly  given  by 


cov  I ija(t)ig°(t)J  =  Ejtja(£)J E I (K.  1 1) 


Taking  the  expectation  of  ija ( jt)  ,  the  means  of  the  extrapolated  and  a 
posteriori  estimation  errors  are  given  b/ 


E^A(£)J  =  +  qa(i.  -  f)J 

(K. 12a) 

e{V*(4)}  = 

(K.  12b) 

Substituting  (K.  12a)  into  (K.  l2b)  and  using  E^ifa(£)J  «•  $a(t-t)ci[ya(£-Oj  t 
the  mean  of  the  a  posteriori  estimation  error  results.  That  is, 


where 


+  [l(£)A§(6-r)-tf£)mt)$*(*-fj]  e[f (&•*)} 

X(l)  =!-<(£)  H(t) 


(K.  131 


The  first  term  in  (K.  13)  represents  the  mean  of  the  estimation  error 

due  to  non-zero  mean  initial  estimation  error,  i.e.,  £jt/£(o)J  0 . 

If,  *  _ 

n  \I-lt(t)tS(£)\$(£-f)~+0  as  rf-*oo 

L  (K.  14) 

then  the  estimator  is  asymptotically  unbiased  if  no  modeling  errors  exist. 

If  modeling  error  exists,  the  second  term  in  (K.  13)  may  force  the  estimation 
error  to  be  non-zero  mean  or  the  estimator  to  be  biased;  in  which  case 
(K.  11)  gives  the  correct  covariance  of  the  estimation  error  and  (K.  13)  the 
mean.  From  the  second  term  in  (K.  13;,  it  is  seen  that  the  bias  is  a  function 
of  modeling  errors  and  F.jya(o)j  .  Similar  results  hold  for  the  extrapolated 
estimation  error  and  its  covariance. 
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Error  Bounds 


Conditions  have  been  reported  by  Nishimura  (References  75  and  76) 
such  that  a  set  of  error  bounds  can  be  computed  for  the  variances  of  the  esti¬ 
mation  error  for  the  Kalman  filtering  algorithms  and  are  correct  for  the 
linear  continuous  or  discrete  case.  The  main  results  are  given  in  the  follow¬ 
ing  theorem  and  corollary. 


Theorem  1 


If  P(0)  ±P*(o) }  Q(t)  £  $*(■£)*  and  %(■£)  %“(<)  for  all  then 


P fit)  *  P*(l) 

for  ail  ~t  -  0  ,  Equivalently, 

[ °(4u  *  [p4«iv  20 

where  the  elements  [P(£)j  t.  and  -  are  the  respective  diagonal  com¬ 
ponents  of  p(£)  and  Pa(£)  .  The  greater  than  or  equal  to  sign  used  with 

matrices,  e.g.,  p(o)  >tpa(o )  ,  indicates  that  the  difference  matrix  P(o)-Pa(o) 
is  positive  semi-definite.  Hence,  upper  bounds  on  the  variances  of  the  error 
in  the  estimate  are  available  even  when  the  variances  of  the  actual  process 
are  not  known  provided  the  conservative  conditions  in  Theorem  1  are  satisfied. 


Corollary  1 

If  f  \o)  at  p(o) ,  Q*(4)  *  Q(t)  ,  andgV*;  ^  P(£)  for  all  H  ±0, 
then  PG(t)  i  p(£) 


or 


P'd)];;  *  [?(*)];< 


Obviously,  the  optimal  estimation  error,  P°  ('L')  ,  when  correct 
a  priori  information  is  employed  is  always  less  than  or  equal  to  Pa(-t)  by 
definition,  i. e.,  -  „ 

P°(-t)  *  P°(£)  V4*0 


Therefore,  if  the  conditions  in  Theorem  1  hold 
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(K.  15) 


P(t)  ±  P  CI)  *  p°(t)  VI  ±0 

anc  P(i-)  can  be  considered  an  upper  bound  on  the  estimation  error. 


However,  if  instead  the  conditions  in  Corollary  1  are  valid.this 


implies 


p(±)  *  m 

Pa(t)  *  P°fr) 


V-6  * o 


(K.  16) 


and  no  relationship  can  be  given  between  P*(£)  and  P(£) 


The  above  theorems  establish  upper  bounds  on  the  estimation  error 
to  be  expected  when  incorrect  a  priori  information  is  used  in  the  filtering 
algorithm.  The  lower  errr.  bound  is  given  by  P°C£)  for  the  linear  Kalman 
filter  and  the  Cramer-Rao  lower  bound  for  arbitrary  estimator.  For  the 
extended  Kalman  filter,  the  validity  of  these  relationships  is  conditioned 
upon  the  accuracy  of  the  approximation  made  in  tne  linearization. 
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appendix  l 


DERIVATION  OF  THE  EQUATIONS  OF  MOTION 
FOR  PDMT  QUAD  DUCT  TEST  MODEL 

The  geometric  configuration  and  the  coordinate  s  -ms  have  been 
depicted  as  shown  in  the  schematic  diagram  of  figure  7-1.  .Vilh  reference 
to  the  coordinate  system  ,the  vector  £  can  be  written  as 

(x  -r)co5d  *  Z  5;n  0  \ 

0  (L.  1) 

'tyaf  r)s,n  6  ! 

V/ith  respect  to  this  same  coordinate  system  the  linear  acceleration 
at  the  model  c.g.  is 

4  'jO  x  {cu  *  t, )  +  oJ  x  £ 
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\2  I  o 
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+  |  0  0  0 

W  0  °\ 


\  Kf 


“i  +  b  {ycfr)s',p6  +  ~  9*  [(yc^~r)&09  e  +  ?03sind\ 

0 

!  ~  4  [  (xf?-  r’)c#s&4  2^  s/zv&J  -  <?  [-(Xq-r)si*e  *  2^  c*sO\ 

The  total  inertia  force  acting  at  the  model  c.g.  is  then 


(L.2) 
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IK  1 

l(MvtA4h)»  s' 

(  M 
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\  Vs 

\  fyv's  1 
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(L.  3) 


Expressing  us  and  tirs  in  the  above  equation  in  terms  of  i*9  ,  elr'  ,  the 
space-fixed  variables  at  the  c.g.  (Figure  7-1),  equation  (L.  3)  becomes: 


I  ^inertia 

!  o 

1  ^inertia  I 


n 


-  92K  I 

0 

-MAhX'^+q2?^) 


(L.4) 


With  respect  to  the  body  axis  system  Xg  ,  Yg  ,  the  above  inertia 

force  and  the  gravitational  force  can  be  written  as 


&in€riia)g 

^ inert! a 

0 

-  T 

0 

i/^/neriia)]i 

^intstia. 

0 

0 

-  r 

0 

(%),  _ 

cos  8  0 

where  T  -  0  0 

I 

\  s  in  0  0 


-  sin  e  \ 

0  \ 
cos  0  I 


Equating 


(X'/rertdg  *  C^^B  *  &tt»ro)g  ~  ^ 

(^inertia) g  *  (  & o)g  *  (^itro)s  ~  ^ 


(L.5) 


(L.6) 


(L.7) 


and  expressing  the  inertia  acceleration  &s  ,  dr^  in  (L.4)  in  terms  of 
body  system  variables,  i,  e,. 
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(L.8) 


1  1 '  \ 
u*\ 

(uB*  feogjcos  0  -t  {jury  yij)  sin  6 

0 

= 

0 

.  /  i 

l«r*  j 

-{“*  *  (lurs)^'  *  *  <Aa  ~  6 

the  following  equations  of  motion,  expressed  in  body  axis  system  are 
obtained: 


-  Mhsin0tos6^I3sin9  +I4C0s6*-g(M+K'1Y)cos  &  *■  2faer0s^  J 


ur 
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+  (M+Mv+Mh  cos  zo)  1 13  sin  6  i-l ^  cos  9  +  $(m*  Mv  )cos  G  *  2aero^ 


where 


**  * 


-  (M  +My  *M^)\j^ur^CrOC  9  ~QVa  s in  #j  *■  sin  6  r  2^  cos  6^ 
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-(M+My)  [-4urgs/n0-fUj<u,sG]  -j  Mv[(X^-r)cos&+  2^  s/n*] 
~q?Mv[- (X^y -  r) sin 6  * 2^ cos  gJ 


Using  the  following  shorthand  notations: 
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M+My 
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the  above  equations  01  motion  can  finally  be  written  as 


'  'Ms  9  -9  s,n  &  j  z, 


'-£-J<U>s26  +  -s**0  +(y&s-r)l~-i--jsln9ccs9  ji 
^ I Zcg  -  (*c9 ~ r) 


1  *  -rr  \cos*d+  —  s  in  Q 


-  [s//7 ZQ  y  aao$zBj  *teros  ~  [(f~e)  sin &e.»s6 j  5^,  -  0 

***  «  -~|(XCl<rr)^a^tf  ^Jrjs//7^j^  /-or^lj  s i»0eosej  ? 


(L .  9a) 
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rh)} 

sinQcosO  -  1 

c9 

<U>s*9+  <3\i+  ~rrjsin20 


+  [cosz9  *  0  sin2 q\  Zaen>B  -  [  (7-  ffj  Sin 6  cos  d]  Xt 


aerpM 


=  0 


(•L.  9b) 


We  now  turn  to  the  derivation  of  the  pitching  moment  equation.  The  pitching 
moment  equation  about  the  model  c.g.  is 

M inertia  *  Mg  +Maen>  (X.-  10) 

The  inertia  moment  is 

-‘W.  -  Jr,] 

Using  equations  (L.  1),  (L.  2),  and  (L.  3),  the  above  equation  can  be  rewritten 
as 


M mertia  “  "  (*cj  4  ~(Mv*^f,\-(Xcq^)s!n0  *Z^cosO ]  ^(u3-t- gazoos  0  t-(drg -^u^sinQ 

-g[-(Xcq'r)<-Zi$MS9)i-‘iZ  [(Xcg-rjccsO  +  Z^  sine)  J 

+^V  [ (xcy -r) aos  8+ 2&3  Sin^  [-/«„  r^)slne  +  (ur9  -queens  & 

+  k  l {xcfr)C0se*-z^  sioBj-t  g2^~(Xc^-r)sin0  +£^€09^  j  j  ^ L 
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(L.  12) 


The  gravitational  moment  is  simply 

=  My  '% S  [iXcfr)0**  9 +  £c<?  Sh'd] 

Combining  equations  (L.  10),  (L.  11),  and  (L.  12),  the  pitching  moment 
equation  about  the  model  c.g.  is  obtained: 

~ *  {Ict+(X*f’m) 2  [v-  sin2 6 *My~j  +  2^  [/% aos2&+M^  - 2\  (x'c?-  r)?^  sin  Seas & J 
~  Mh  f~  l*cf  r)s'ir>  &  ♦*  &>s  &]  l(i/g  +  ?  (traces  e 

V  [(x^ -*-)<*>=&+  zcs  *;»&]  ] 

j(Xcf-r)(^9 ~  9as)~  +  Sin  ff)j  +  Mac„g  = O  ( L.  1 3) 


Linearization  of  the  Equations 

For  fixed-duct  tests  at  the  PDMT,  assume  that  small  perturbations 
about  a  constant  trim  may  be  valid.  Then  the  linearized  version  of  the  above 
equations  about  ag  ,  urt  ,  90  can  be  written  as 
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(L.  14) 
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where  the  variables  are  perturbation  values,  and: 
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A  primary  advantage  in  the  linearization  cf  the  general  nonlinear 
equations,  (L.  9)  and  (L.  13),  is  the  fact  that  the  inertial  coupling  through  the 
square  of  pitch  rate  is  eliminated,  and  the  equations  may  thus  be  written  in 
terms  of  conventional  state  and  control  variables.  A  straightforward  matrix 
inversion  enables  us  to  write  the  equations  in  the  general  form  x  =■  Ax  +  ~BU. , 
that  is: 
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